» 



DOC0H2IT RBSOME 



BD 207 5B6 

&OTH05 
TITIE- 

ihstitotiom 

spohs agehct 
bepobt no 

POB DiTE 
BOTE 

EDRS PaiCE 
DESCBIPTORS 



IDENTIFIERS 



Goldstjeitt, Ira 



C 



I£ 009 70<| 



The Coiputer as coach: fn Itktmc Paradigi tor 
Intellectual* Edtrcation. il/aeiib 389. 
Hassachasjatts Inst, of Tech. ,7cafcl)ridge. Artificial 
Intelligence Lab. / 
National Science Foundation, (dashington; D.c. 
L060-37 

Dec 76 ' . 

75p.; For a related. ^ocui^nt, see IB 009^705. 

HF01/PC03 Plus Postac)e. , 
Artificial Intelligence; *Coiputer Assisted 
Instruction; Coiputer Prograis ; *Ga«es; ♦Models; 
♦Research Design; *Tutoring 

♦Coiputer Gaaes; *I^telligent CAI Systeas; Tutorial 
Hode; luipus 



ABSTRACT 

■This paper is a preliminary proposal to develop the 
theory and design for "coaches" for co'iputer gaaes, to iipleient 
prototypes, and to experiient with th,eir ability to convey important 
intellectual skills. The focdfevOf this project will be restricted to" 
developing a coach for a single exaiple of an intellectuax gaae 
called Buipus.It is pointed out that, while coi£uter gaaes have a 
powerful. educational appeal, they also have a liaitation in that the 
plajer, on his own, can fail to' acquire the skills of an expert. A 
computer coach, which could provide advice on strategy tactics 
for better ^lay and t-utor basic latjieiatical, scientific, or other 
kinds af knowledge related to the gaae, could over'coie. that 
liiitation. The project would address three specific questions: (3) 
how the expertise can be designed in the coach so that it can respond 
ireawnably to th«. player's particular choice of move; (2) ho^w the 
player can be lodeled sufficiently so that th^ coach's rewrks are 
Appropriate, i.e./ neither too advanced fot- a^feginne'r nor too 
eleaentary for an expert; and (3) how th'e nature of thafccoach's ' 
advice can be controlled so that it is given in a friendly and 
personal aanner. Pi|tj-six references arte listed. (Autho'r/LLS) 
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. , . Abstract ' 

Ov«r the next five j^rs, computer ganes will find their way 
Into a vast, nuaber of Aaerican ho«es, creatino a unique 
educational opportunity^, the tfevelopfflent of "conputer coaches" 
for the seriQus intellectual skills required by some of these 
oases. FroB the play^'s perspective, the coach will provide 
advice reoardino straiegy aAd tactics for better, play. But, 
froB the perspective fiif the cbach, the request for help is an 
opportunity to tutor rbasic aatheMtical, scientific or qther 
kinds ar knowledge that the gaaq exercises. 



Ills -dsually 



Establishing an "athletic" paradign for skil.. *xj 
considered the antithesis of ordinary sports is an exciting 
prospect. There »#^, however, critical research issues which 
■ust be addriisstdv. While the hardware needed for gaaes and 
coaches Will contlmte to drop in cost, the software technology 
(and related educ#kional and psychological theory) for dasigninfl 
coapatant coachef^itloes not yet "exist. This is a proposal to 
develop Uia theo|$ and design. for such coaches, to iapleaent 
prototype, and to axperiaent with their ability to convty 
laportant inteU*«tual tkillt. 
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Thii paper if a pr.fliainary proposal subaitted to the Science Education 
Oirtctoratt of , the National Science foundation. 

MparMMiit of Electrical .Engineering / Computer Science and the Division for 
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Todty TV^guts fdr s^auUted ping pong, soccer and handball are anong the 
Mtt ajtcitlng Innovations for the hoM enUrtainaent aarliet. More exciting qum* 
In which the playar pilots a sp<ca ship or drives a race car exist fdr t^e 
co«»ercUl Mrket recraitlon roons In airports, and other public placas. 
Thasa a^a only the first stones In tile approaching avalanche of;*. TV guai. 
Already there are devices that take cassettes on which new programed gaJMS are 



provided. Aaong the vast array of coaputer video games yet to be urketadp so«i 
will exercise serious Mtheutlcal and ysclantlflc knowledge. 

In PING pom. SOCCER* and HANDBALL, the'0layer controls a paddle so as to hit 
^ Bovlng 'ball' Into an opponent 's^oal or othar such target. These f'lrst 
gener^lon gaaes provide a^llalted Intellectual envlfonAent. Second generation 
gAMS In which the player controls a space crafti boat or^ a race car are still 
too expenslve^ for the hoBM. These gaaes Involve controlling a vehicle given the 
coaipllcatlon of skidding for cars, drifting for boats aitd Tailing for space 
stilps. They. Mke greater Intellectual deaands on the . player. Successful 
navigation requires knowledge of ge6Betry, dyffurlcs and klneaatlcs. Third 
generation gaaes will have' available powerful 'coaputatlonal resources: the 
^ssibllities are ayrted. For exaaple, consld^ STEVEDORE, a hypothetical gaae 

that illustrates the range of posslbilit^s. In this gaae, thp player 11 asked 

\ 

to load a cargo, given various sets of slaple liacbines. The.aachinas have costs 

^ '\ * V 

associated with thea: the task is to find the \cheapest coabination of slaple 
Mohines adequate to aove the wfight to the desired location. Successful play 
involves in a natural and active way knowledge of ^lenentary physics. Finally, a 
set^ of third generation coaputer gaaes already exists, having i>ee|i developed in 
the^context of efforts lik^ PLATO (such as (foW THE WEST WAS WON). These chn ba 
translated to the hoae aarktet. 
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Such 0«Ms havt a powtrful tdircatlonal appeal. They will ba: 



!• widespread : the calculator pherioMnon -of drastically reduced prices is about 
to be repeated for coaputer^based TV gases. Research ^In education can try to 
4ihe ' advantage of this phenoMnon, or Ignore It; but It will happen In any 



case, 



2. active ; knowledge learned^ Is used for a purpose^ What angle < of the paddla 
win establish the deslrid trajectory of the ball; idiat force Is necessary to 
•nter a stable orbit; what coablnatlon of slaple aichlnes can lift tha 



desired weight? The passive envlronaent of the traditional classrop* or 

f * 

•ducat lonal television Is avoided 

' , ' ' 

3. Motivating : coaputer gases will be played because thay are enjoyable* not 

J ' • I ' 

bjec^use of so^e external deaand aade on the studant. The desire for 

J * 

* 

Instruction to laprove bis play arises naturally on the part of the player. 

However, gaaes have a llaltatlon/ the player, on his own, can fall to 
acquire the skills of an expert. This suggests that coaches be developed for 
^coaputer. gaaes. Froa the player's ^perspective, the coach will provide advice on 
strategy and tactics for better play. But, froa the perspective of the coach» 
the request^ for help l/^arr opportunity to tutbr basic aatheaatlcal, scientific or 
other kinds of knowledge that the gaae>xerclses. j 

Huaan coaches ^re possible, except that the gaaes wlll^be so widespread that 
it will be difficult to supply the required nuab^r of skilled .teacher^s . 

Furthenaore, the gaaes are often dynaalc, aaklng It difficult for a huaan coach > 

ff 

to follow the play In^f^eal tlae. Hence» our proposal Is to develop and test 
coaputer c<]|achtfs. , \ 

There Is another vlrtue#to the design of a coaputer coach ^ the r^gor 
required to write a prograa provides a' controlled envlronaent to study basic 
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qutstiont of learning and Reaching. Insight into thesa questions will htve^ 
theoretical valu# for education ifxtending beyond the direct application of 
coaputers. 

Thus, we pro^a^ to ^levelop the theory and design for auch coachea. to 
lat^lettent prototypes a/ic) to experiment with their ability to convey ioiportant 
intellectual skills. Specifically, we will acfdress these questions: 

How can we design expertise in the coach so that it can respond reasonably to 
the Player's particular choice of aove? If the coach forced the*^player to view 
the gaiae in only one way, it would be a straight- Jacket . To avoid this, the 

» 

coach Must be able to analyze a wide variety of aoves and discuss their 
relative aer its. Progress in artificial intel'lioence (AI) aakes this a 
possible goal for the closed world of a game. We propose to apply AI to the 
theory and design of an "Expert" component in the coach. ^ 

2- How can we aodel the player sufficiently well so that the coach's reaarks w% 
appropriate, neither too^advanced for a beginner nor too eleaentary for an 
expert? Here we propose to apply the foraal aodelling tools of information 
prQpttsing psychology to the theory and design of a "Psychologist" -coaponent 
in the coach. ^ 

3. How can we control the ' nature ef the^coach's advice so that it is given in a 
friendly and personal aanper? The solution lies in having: an array of 
possible interaction aode^ ranging fKoa graphics to nature^ language; a 
theory of how to abbreviate coaple/ explanations; and a aodel of the player 'a 
learning preferen^s.^ Both AI and information processing psychology will be 
used to dtsl(jn % ^Tutor" coapopent, of the coach with these capabilitiea. 

The design of a successful coapuieq coach is a difficult enterprise. But we 
are abo^ to ixperience the explosive diffusion of coaputer gaae technology. If 



CoMht. /. ^ irtQoldiU4n 

««• art successful in taking aducational advantaga of this, tha rawards wiU bt 
anoraNNis. ' , 

Cbaptar^ outlinas our datign for a Coaputar Coach in tanu of aodulas that 
.hava rasponsibility for doMin axpartisa. for Bodalling, for tutoring and fpi» 
OMarating Cntflish prosa. Each aodula fs basad upon a rula-basad fonMlation of 
tha appropriata knowladoa. Chaptar 2 providas dati^ils. 

Chaptar 3 raviaws ral^yant rasaarch in AI, infortwtion'procassing psychology, 
and coaputar aidad instruction. Tha coaputar c«|ach owas its graatast 
intallactual dabt to tha work of J. S. Brown and his collaagiias who hava 
pionaarad tha dasign of coaputar-basad tutors for various doMins. 

Chaptar 4 dascribos axparlaants to avaluata tha coaputar coach paradiga as a 
vahicla for tutoring transfarabla intellactual skills. Phasa I involvos tha 
^■••^•••"^•^iw and tasting of a coach for an altaantary probability gaaa. Phasa 
II analyzas tha paradiga for othar gaaas. Phasa HI is addrassad to tha 
articulation of a ganaral procadu^al thaory of coiching. Sinca phasas II and HI 
ara dapandant on tha succass of phasa I, support is raqoastad only for phasa I as 
a two yaar rasaarch projact. At tha end of t^s psriod, tha progress sada on 
phasa I will dataraina. the appropriateness of a now proposal requesting support 
for phases II and III. 



^ ' • , . Ira Goldstaln 
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( # 

^ I. Dasionf for a Computer Coach 

I A Block Dlagraa ' ^ 

FiBur. 1 ii a block diagru of the das^gn foV- a co«puterytoach . ' We have used 
tnthropo«>rphlc . deilanatlons /or the Expert, Tutor and Psychologist nodules of 
the Coach to eaphaslxe their purpose in the overall systea. Of course, thet* 
coaponents will far aora Halted than their huaan counterparts, although wa 
^ believe It Is possible to get significant perforaance. To stress. that we are 
referring to coaputer priograas and not people, we capitalize references to these 
• aodulei. In the text. . ^ 

^ The function of the Coacfr is to tutor the player in partlculaf skills. In the 
^eontext of situations where those skills are appli^cable. It does this through 
the Interactions of the spiclallst prograas appearing In the block dlagraa. Tha 
Expert Inforas the Tutor ft the player's aove is nonoptlael and which skills are 
needed to discover b,etter alternatives. These skills are potential taplcs for 
the -Tutor to discus^. Tha Psychologist exaalnes the student's behavior and aakat 
hypotheses about which skills are already possessed .by hla (recard«d as tha 
Knowaadge aodel) and which tutorial aodes are effective In conveying new skills 
to hla (recorded as the Learning aodel). The Tutor u^es these aodels to 
parsonallz»-lts Interactions with the player. Tht^ Knowledge aodel guides tha 
aalactlon of topic froa those suggested by the Expert while the Learning aodel 
influences the choice of explanatory strategy. Finally, a Speaker converts the 

» 

foraal explanation of the Tutor to an appropriate fora for the player. Usuafly 
this would be English, though graphical explanations are also possible using tha 
TV t» a -display. 

' This design has grown out of a close collaboration with B. Carr, H. Nillar and 
J. Stantfleld of BIT and J. Brown and A. Collins of Bolt. Baranek and Nauaan. 
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\\Z Theoretical Go als; Towards 'a Theory of Coaching 

The' theoretical goal of this rttseach is to study fundaaental questions In^the- 
theory of learning, aodelling and teaching by constructing procedural vi^le 
systeas for (1) the skills needed by the Expert to play the game, (2) the 
■odelllng%rlterla used by the Psychologist. (3) the alternative tutting 
strategies used by the Tutor, and (4) the language generation capabilities of the 
Speaker. We expand on eacfi below: ' V. 

1. The Expert will use rules of skill which enbody the knowledge r^^qulred to 
play the gam and thereby analyze the player's behavior. The vlrtu^of a rule- 
based representation of expertise is that its aodularity al>«rt«tutorlng' to be 
focussed concisely on the discussion of specific skills, "aiiitpe raits BOdelling to 
Xaks the form of hypotheses regarding which rules are known' by the player. 

A possible confusion should be clarified here. When we refer to the rules »f 
the Expert, we ari not referring to the "rules of the ga«e". i.e. the facts 
describing a leoal aove and what' constitutes a winning state.' Rather our concern 
is With the tactical and strategic knowledge needed to decide which Bove aaong' 
the legal possibilities to aake.* We -tera these 'rules' because our 
representatioif Mthodology is to structure the skills in teras of rule sets. 

2, The Psychologist will use rules of .evidence to Make' reasonable hypotheses 

t 

about which skills of th^, Expert the player possesses. Typical rules would be: 

A- Increase the estiaate that a player possesses a skill If the player 
explicitly claias acquaintance ifith the skill; and decrease the 
reliability if the player expresses unfaailiarity. 

B- Increase the estiaate that a player possesses a skill if the skill is 

r 

■anlfest in the^ player's behavior; decrease the estlaate if the skill Is' 
not Mnifest in a situation where the Expert believes' it to be appropriate. 
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Hanca,- laplicit asx^U as ovart evidanca plays a rola. ' - 




C. Dacraas^.,AKa >|sybata that a play4r possassas a skill if thara Is a Ivtg 
y interval slnca tha last confiraation was obtaihad (tharaby^ ■wdalllng'^tha 
^ tandancy for a skill to dacay with littla usa). 

3. Tn« Tutor will \x<% ruljs of explanation to.stlect the tpproprlite topic to 
distuss with the plilrtr and to choose the foni of the explanation* These nilM 
Include: 

A* Rjiles of slapllflcatlon that take a c<pplex statement and reduce it to a 
slBpler assertion. SiBplification rules ar? essential if the player is not 
to be oven«heliied by the Tutor *s explanations. 

B; Rulas of rhetoric that codify alternative ex^anrtion strategies. Two 
extreMs are explanation in teras of a general ru^e* Versus explanation in^ 
tenis of a concrete insjtance. 

4. The Speaker will lise rules of language to convert the foraal nessao* 
selected by the Tutor to Ifnguistic fora. l^is involvM^jn AI language generator 
which we discuss later in the paper. Various neclianiSBS of language for 
achieving brevity such as anaphora and ellipsis would be applied. 

Thasa rasaarch araas ara difficult, touchinjo upon daap Issuas in psychology, 
education, linguistics and artifical intelligence. But, we believe thare is. an 
opportunity for programs for three reasons: ' 

I. HordelUng and tutoring are biAng exaained in the constrained context of a 
gaae. A gaae has a foraal structure,, a restricted nuaber of options, and 
involvas a liaitedt nuaber of skills. Furtheraore, these constraints pake it 
poai>sible to build a competent Expert for the doaain. , 
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2>. Th« research is an integrated e'nterprise with the potential for a synergistic 
effect. For exfiple. the. Ps^rchologist uses the sane ^inplif icatioh rules to 
0«neratb a siaplified version of the Expert for the\intti<al model of the 
Player, as the Tutor uses to suinarize an explanation. -^iBilarly, the overall 
Mthodology of representing knowledge as procedural rule'teto is being applied 
to. all of the. coBponents of the fpach. ' ; 

3. The rule-based' conputational paradign which, we intend to exploit is a powerful^ 
one and is particularly appropriate to the dynaiBic deaands of a' theory of 
interaction between coach and player^ 

l.J Experiaental Goals: A Coach for an Elementary Probability Game 

In view of the many difificult issues raised b^^r theoretical goals, the 
ekperiieental focus of this proposal will be restrit/ed tb developing a Coach for 
a single example of an intellectual game — VAimpus. (Although '^he tutoring and 
sodalling components 6f the^Coach will be designed in a modular, dosain- 
independent, fashion which will be transferable to a wide range of tasks.) A sat 
of axptrimafits described l,n chapter 4 will test: . . 

1. the relative merits of alternative designs for the module^ of the Coach, and 

2. the overall success of the iCoach in facilitating t|^e acquisition of 
^ transferable intellectual skills, ^ . 

Tha Vuapus gaaa was created by Qregony Yob [1975], as nn improvement to other 



games he had seen being played by computer hobbyMts. (Thus, it is further 
evidence for the manirfold possibilities^ that exist for the computer game 
en^^it^ment . ) It exercises llfsic knowledge of logic, probability, decision 
analysis and geometry. It is not yet available for the home; but. Judging t>y 
the enjoyment our HIT implementation of the game (with no coaching) has provided 
to players ranging in age from elementary school children to adults, we think it 
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lii*vlt«b\t that ictivlttt of thil kind will appfir 'uwng. tht ihlrd gtntratlon of 
tcttpattr e«Mt. (Its dwmds on coaputtr fttourctt art slight.). . 

*T1it o«M is i ■odtrti day virsion of Thastus and the HinoUUr. The pUytr Is 
liiitially plattd soiitwh^pt in « randomly connacttd warden of caves and told tht 
)iitiohb9i^ of ^is currant locftt An. His goal is to locata^ia^orrid Wimpus b^ast 
In tht ifctran and slay it with an arrqwi Each p^ya tcrT^aighbpring cava yields 



inforaatMN^^arding that' cave* s neighbors. The Idifficulty in choosing a^aove^ 
arl,sfs froA the existence of dangers in the warren batsi" pits and tIM wapus. 
itself. * If the player aoves into the Vuapus'^iialrt he is e^ten. If he walks 
into a pit; he falls to his death. Ba^s pick the player up and rando«ry.drop hia 
elaew h^ in the warren But tife player can ■ihtHlre risk and locate the Wuapus 
by Mking the proper loiflstK and probabilistic Inference^ froa warnings^ he is 
given. Thesr^amings are proyided whenever the iilayer is in the^ vicinity^ of a 
danger. The Wuapif^ can be saelled witRin i)ne or two caves/'^The squeak* of bats^ 
can be heard one cave away and the breeie of a pit felt one cave away.* The gaaa 
is won by the; player shooting one of hi) arrows into the Wunpus' Iplr froa an 
adjoining cave. If he exhausts biuret of five arrows without hitting the 
craatiira, he. has lost ^e gike. Figure 2 illustrates typ^^al interaedlata^ 
state a player vight reach. « 

Skill Id play exercises basic skiTls in: * 

A. logic^-- Baking «deductions in those situations where coi^lete ki\owledge^s 
ayaj jfible, e.g. reaUaing that all neighbori of a cave are safe if no warning 
la received, ' ^ ^ . ^ ^ 



gfij^bahility --^selecting the besi 
kJ^lni that the likelihood that a 

1 ^ 



best choice given uncertain knowledge » a.g. 
cave contains a danger iivcriases if there 



are warnings froa aore than one neighbc 
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SCLED CAVES -HAVE 



VISITED BY PLA?ERi 



Sm.= Wumpus Warning 
Sq = Bat Warning 
Br =• Pit Warning 



^ - FIGURE 2 

AN INTERMEDIATE STATE IN A i^Pj^AL WUMPUS GAME* 
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C. dtcision Mking ttUcting tht aovt with hightst utility by balanelng 
InforMtion gain agftinst incrtasad danger, and ^ 

• ^ * 

D. . otoattry - in som variations of tha gaaa.. deducing conitr'aint«^fro« tha 

^* l*'"^''^*- ^« c" »>• Pl»y«d in warrani ranging 
fr<p ganaral 3-dlMnsfonal lattices to 2-diMnsional'rectahgular grids. 



^^^^^^^^ 

.In addition to beiHg a Mtivating and intellectually challenging gaM. Vuaput 
also has the virtue thW^we.have already had som axperience with this gaM. Our 

. axparience derives froa a course given by the 'Division for Study and Research in 
Education at HIT by the author and J. Stansfield. The tlass project was to 
daalgn and iaplepent a siple' advlior-for the Wuapus gaae [Stanafield, Carr ft 
Coldstein 1976]. This advisor called WU80R has been subsequently developad .by 
B. Carr. He has iapl^Mnted 'a powerful rule-based expert for the gaae with 

^ llaittd Mdelling and 'tutoring capabilities. The design proposed here is based 
on that experience: howe^r. it reppesints a significant extension along tho 
dlMnsions of iaproved Mdelling. tutoring and speaking abilities. Tlie naturo of 
these extensions are the subject -^t^chapter' 2. FurtherMre. no version of tho 
Wuipus coach has, as yet, been subject to^rigorous evaluation. Chapter 4 
outlines a thorough eptperiMntal prograte to Met this goal.^ 

1.4 A Hyp othetical Scenario with a Conputer Coach 

a ' 

To illustrate the potential use of a coa?h as weiris the intellectual skllla 
Involved in playing the Wunpifs gane. we provide^ hypothetical scenario of a 
player Interacting with the proposed Coach (henceforth called COACH-1). Tho 
player^ r4sponses are preceded by a •>•. - 

. 15 
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roil ire NOV afr caw 16 ittt*' wtgfcAor^. 4, 14 oittf ff. Brrr/ r^ere 

a dro/t; Voii ^re Mear « Alt. VAat^ a 3teMcA. FAe Vumpu3 U 
ffvar/ WAat *<Mi7 . ' * 



roM are mow oKcoire 4 ^UltA^elfrA^or^ 16^ 14 and 2. BrrrI 
Squeakl A bQt U near, Vhat mom?^ 

Figure 3 Is a typical picture drawn by a player to record the infomtlon learned 



abotff^the warren. 




FtfMfe 3.** itJiovletffe o/ tifk mcrren QjUr wisiting 2 coves 



^ ; f 

The goal of the Coach U ^to tactfully tutor a beginner 4i the relevant 

logical, probabilistic and strategic knowledge needed to play the gene. For 

exaaple. on^ the basis of the ibpve knowledge of the warren, cave 14 should be 

treated as More dangerous t^an 0 or 2 since there is aultiple evidence* (frcNi the 

drafts In 19 and 4) that'll tains a pit. If the player soved to cave 14. a 

coaching situation Bight occur ts follows: • 

> 14 
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aoooo4bt9Ml Yon Awf'/ftUii U a Ht[ VAct noil — cofcAtnf . ) 

> Cotcktiif 

roil Afltf jtRfle «irt deuce t*«t ft contafnecr o pit. but iotbU 

tvftfefce /rfr cave 14.. , 

f 

> crave 9 a better mowe tkU cave 2. 
Yes. Ceee 2 contetffi a Ht. ^ 

Although It U net'^oparent frov^these staple reaarlis, every sodule of tho 
Coach contribut«d to the dialog. Wt siMMrlze these interactions hero under the 
^hoadings tutorinji. Bodelling, explanation, discourse, and natural languago 
cMprehension; then develop the theory and design for each ceaponent of tho 



Cooch in the next chapter. 



r 



1. Tutorlno:, The Coach l||id the option of Interrupting iMetf lately upon the 
player's aove to cave 14. Ins.tead. it allowed the player to learn directly of his 
fatal aove. The decision whether to intervene iaaedia^ely, or only upon request., 
is oade by the Tutor on the basis of the Learoing aodel. The Learning aodel 
records the Psychologist's^hypotheses regarding whether the jOayer prefers 

t 

iaaediate intervention or not. In this case, previous experience with the pUyer 
resulted in the belief that intervention only upon request was desired. The 
Tutor also considers whether teraination of the giae should be avoided becausa 
other learning opportunities exist in this particular state of ' the gaae. This 
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wouLd be dtterBlned on tht basis of the .Expert's analysis of the skills needed^ to 
^ty the gaae in its current state as covered with the l^owledge aodel'^t 
hypotheses regarding those skills in need of practice. ^ ^ 

2. Hodellinq; jBie aove to cave 14 causes the Psychologist to decrease the 

Knowledge aodel weight indicating faailiarity ^ith the Double Evidence rul|^. 

(This is the Expert's rule that assigns an increased probability of danger to t 

cmve for which there is double evid/ince. A saapling of the Expert's inference 

rules are given in the next chapter; the Knowledge nodel contains a nunerictl 

eetiMte. of the Player's knowledge 0/ each rule.) 

Hodelling raises aany issues. One subtlety is that the aove to 14 aay be 

evidence of a w>re eleaentary limitation a fail^ure to understand the logical 

Implications of . the squeair Earning, i.e. that a bat is in a neighboring cave/ 

The current state of the Knowledge^del is used by^he Psychologist to deterviM 

^whlch skill is Hissing when a nonoptiaal aove is aade. The Knowledge aoclel 

indicates the level of play 'which can be expected ffoa this player the player 

■ight btf.a pure beginner with inc^oaplete knowledge of Vhe basic rules^of the 

O^ae, a novice with understanding of the logical skills, an a^^ur with 

knowledge of the loglci^ and the nore Jleaentary probability skilf^ etc. The 

Psychologist would attribute the^ unUailiarity to an skill at the student's 
♦ 

current lev.el of play in thi^ ca;e, we are pr^uubly dealing with a novice 
player who has Mstered the logical skills and is leamihg the basic probability 
heuristics. > 

* Another subtlety^rises froa potential interactions between the^player'e 
choice of| representatid|p Mhiae and his application of the logical and 
probability AiUs to the inforsatlc^^^cof^tained in that representation. He Bight 
know the double evidence rule, but have r^prylo(ed the inforsation incoapletely, 
end hence have not recognized its applicability. The Psychologist can choose to 
control ior Vhi% by providing e^iraphic representk'tion for the Player. 
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7' 3. Explanation! Tha rasponsa to tha'playar'i initial raquast for cotchino " 
*Ca¥t 0 waS'Safar.* is abridgad. Tha raason for this is that tha coaplttt 
•xpUnatlon My bt ovtrwhtlaing to tht player. For txaaplt, tht Export will bt 
eaptbli of tha following jcoaplata analysis (axprassad hera in English, althouoh 

tha ExpartM analysas will ba fonaal darivations, rasaobling MthoMtical pfoofs 

♦ 

rathar than taxt): « 

Cava 14 ms aot tAa best wore. tortco{{f, tAa Vumpus cajHrot-^e 
in 0, 2 or 14 since tAera is no smell in 4. But caaai 0 eni 2 
^ mere better then 14 beceese there 0es sinele eeiience thet ceees 
0 end 2 conteinei e nit, bet iouble eeidence for cava 14, 
Finellf, ceee 2 is more ienterous tk'en cone 0, Jiaca 2 coatataj 
a bet, end the bet coeli iron toe-in a /ata{ taaa. XKo sfueek 



■ ( 



in 16- rules o^t the nossibilitt of a bet in 14i hence, the 
sfueek in 4 cen onlfi be exnleinni bit e bet it 2J Thus, the beit 
moee is to caaa 0. • * 



Giving a co«plat| axplanation ctoas not ancouraga rifflaction on tha playar^s 
part. Hanca, tha Tutor prunas tha coaplata Analysis on tha basis of 
siapllf ication rulas n/ti providas ojly'^a h#adlina; Additional inforaation is 
givan only if raquastad by tha pla|ar. ^ 

4.. Discoursa; Furthar bravity U obtainad by tha Spaakar aodula's usa of 
al^psis. and anaphora in ganarating English raplies for tha playar. For axaMpla, 
tha Cofich bagins with tha alliptical uttaranca *Caya 0 is safar*, rathar than tha 
cottplata clausa "Cava 0. is safar than cava 14.* Tha allijpsis is Justified by tha 
context, in wKith tha play%r has Just aov^d into the fatal cave 14. In tl^e next 
statMMnt by the Coach, "You had single evidence that it contained a pit, « 
pronoun is ufad %o refer to cave 0. 

'The underlying foraal explanation of the Tuto ould have hid this 
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rtpttition. as It wlil ba ^coapo^ed of logically coapleta stateMnts regardliio th« 
rults in .ai^alyiing the risk of varlout »ovas. In the absence of any dlscburs* 
rules, the Speaker would have, ■irrored this repetition in the generated Eniillsh. 

• » 

Th^ reader mV Teet we are Hking too strong ft virtue of brevity. However* 
the ability to Mke concise, appropriate resarks is a critical @capabiLUy of the 
Coach. Otherwise the enjoyment of the gane and the efficacy of the tutor will 
^ffer. , Miles for slAplification, both for the underlying conceptual level and 
the surface syntactic level/ are an important part of a gerl^p^al theory oJ 
coaching. ^ 

Of course, thi Coach can err on the side of too au^h br^vlrty. Confusion can 
result froei saying too little as well as too auch. This is partially alleviated 
by'givinO tHe player the ability to ask questions! which we discuss next. It l,i 
also addressed by incorporating into^ the Learning aodel thA Psychologist*^ 
^ hypo*thests regarding whether the explanations are proving satisfactory t^ the 
playar, as^ estiaated by the player's responses and subsequent behavior. On the 
basis of these hypotheses, the use of particular siaplification rules can be • 
edjusted. 

5* . natural Language Comprehension: While aost of the player'^ responses were 
siaple onr ^rd reaarks, his last response was th^ quest ioni cave 0 sffer 
than'^ve 27". The Listener, using standard AI techniqdes, parses this sentenc% 
into a forBal representation that indicates that the student is asking a^questioh 
about two aKernative a<pves. This raises the question of what claas of 
^ utterances the Coach can be expected to coaprehend. 

^ Our plan is for the systea^ to understand those foraal queries that already 
occur^on the coaaunication channels between the PsychologUt, Tutor and/^xpert» 
i.e. ^pne can conceptualize the Tutor • Psychologist and Expert as constantly 
^ asking questions oiie of another/ The student's question is answerable if it 

« 
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> . • ' ■ • .. ■ 

falls MOfis this clitt. / ^ 

Froa this ptrsptctl^t tht Job of tht LlsCsnsr Is to convsrt\tht roMrk to 
Its foraal fora, or dtcldt that It Is not coaprthnslblo. Vlnogrtd's 8HRDLU 
progrM [1972] ind Woods* LUNAR systM [1972] can perfoin such coiivsrslon for • 
roasonablo ranoa of English constructions, providing thara ^ls'a wall-dof Ihod 



dlscoursa world. Tha sat of forsal quarlas pantlssabla batwaan sodi^los of tha 
Coach Is such a world. Thus, tha design of tha Coach as a coiaunlty of 



coHHinlcatlfig spaclallsts Is Justified both by tha vlrtuas of nodularity and by 
tha support It provides for a language capability. 

IQ the scanerlo, the question Ms cave 0 better then ceve 27" raqulrts an 
analysis :j)f the relative aarlts of iltarnative aovas a capacity basic to the 



^.Ej^erV* Thus» ^thyCoech can raspond appr^pl-letely. 



(Tha ability to be artlcule^e about Its own thinking Is critical 
for another raason: If a hUMn taachar Is to accept the Coach 
as an aid, ha or she aust be convinced of its coapetence. 
Requiring thet the teechar exaalna the code.ls absurd. Instead* 
wa envision the teacher pretending to be e studant, and- than 
daaandlng axplenatlons froa the Xoech for Its 4>ehavlor . Hahca. 
th« design philosophy of coMunlcatlng spaclallsts Is essential 
If, tha Coech Is to be able t^^ expleln Itself.)^ 



Finelly, e reaark about the coaplexlty of the Wuapus geM Is epproprlete. If 
the player hed not aoved to ceve 14, the geae alght have continued until an 
IntenMdlete s.taie such es that shown aerller In figure 2 was reached. At this 
point, the ga«e Is quite chellenglng; for exaaple, the reader aay be surprlsad 
to learn thet a careful application of the logical rules of the gaae allows on* 
to deduce thet the Wuapus Is In oevi 12. However, the gaae does not becoae 
significantly aore coaplex for the Coech. TTie Expert reaains able to analyze the 

\ 
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probability of danger for all possible novi^ to unvlsita(} caves with the 
bookkeeping abilities of the computer preventing confusion. The tutoring and 
modelling continues to be- focKfsse^ on the difference between the player *s sove 
and any bettir aoves the Expert discerns. 



The next chapter discusses the^proposed design for each hodule of the coach. 
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2.1 Tho EXDTt ' ■ j , « 



Tlio block dUoraa of figurt 1 shows iL proainont aodulo for tho 'doMln oxport 
Tht incorporation of such an Export raprsssnts a basic ^nsight of work in cocmt 
CAI: Intatiloant tutoring raqulras knowladga of tho subjact aattar. Tha powtr 
of such knowladga Is saan in tutors for goography (Scholar [Carbonall 1970]), 
alactronlcs (Sophia [Br^wn * Burton 1975]), sat^haory (Exchack [Saith ot nl, 
l^TftJ). and arithMtlC (Wast^Burton * Brpwn 1976)). At HIT, wa hava davalopad 
now Bodals of apcpartlsa for planning and dabugglng [Gol^stain * Qrlason, in 
prass; niUar * Qoldstaln 1976a]. 

An Expart for Wuapus laplaaentad by Carr will provlda tha naadad 
undarstandlnt of tha .playar's options that Mst ba avallabla to tha Coach. Tha 
€«part's knowladga consists of a sat of 20 rulas dascrlblng various logicil. 
probabilistic. gaoaMtrlfc and ^trataglc facts about tha gaM. a fow of which ara: 

/hileji /or Sat< k Pits j 
til f'posltlve aaldeaca mla; A mmUi in • cave. l«pll as tAat a d»far axists la 

* ♦ 

a neighbor. 

U, raafatlaa aaldaaca rala/ r*a a^saaca o/ a merninq impliis thtt no tfaa#ar 
axtsts la aajr ii9i§hbor*. ' ' ■ - 

tai fellMfaatlaa m\o) If a cava kts a miming and oil tut ono of its noighbort 

are knomn to be sefe. the^ tke danfer Is la the remaining neighbor. , 

' * ' • , , • 

Probabilistic Ibtles for Bats A Pits ' 

Pi, (efuel likelihooi rule) In the ahtenc* of other knowleige, ell of the 

neighbors of a cava with a warning ara enuallg tiltelg to contein a 'danger . 

P2, (double eeidence nle> INltigle^marningi increese the iikelihoo€that a give 
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TKe rules are giverf el^plicitly f^r bats ^nd pits, but the same inpllcatlons 
ari true fp?> the Wuapus, except that warnings propagate tiro caves. Note that 
Uiete "rules* are not the rules of, the gane, but rather inference rubles fron 
which the best aove can.be deduced, m inference rules include the rules of the 

4 ^ 

gue plus fjeneral strategic knowledge about probabilities and constraints. They 

are essentially rules of scientific induction. 

The experimental goal of this proposal is to develop ^sophisticated modelling 

and tutoring capabilities. However, this goal does not diminish the iiDgprtance 

' i- 
of the Expert,. Indeed, the first design principle for such Coaches Xs that the 

nature of the 'other components of the Coach depends' in critical -ways on the 

Expert the Psycholog^ist. models the player in terms of subsets and 

simplifications of the Expert's knowledge while the Tutor selett) an appropriate 

>ssue partly by referencing a Syllabus representing an drdering on the Ex|>ert's 

knowledge. 

2,2 Thai Syllabus . * ^ - 

A syllabus is needed for tke Cffch to determine whi^ intellectual issues to 
discuss with the player. In figure 1, the syllabus appears ^on top of the Expert* 
This is to emphasize 4hat; a rule based theory of expertise allowi the development 
of a syllabus in terms of subseU and simpHJications of the Expert's rules. 

Selection of subsets of the Expert's knowledge as intermediate goals for the 
Xoach is based upon the complexity o ious rules and their inter* 

dependencies. For W|aple, the logical and probabilistic rules of Wumpus form 
twe subsets of the Expert's knowledge, with the najtural tutorial sequence being 
to begin with the lo^ica^ rules. This is required by the nature of the rulef^ 
since knowledge of the logical rules is needed to properly apply tK?^probability 
heuristics. . « 
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m' utility of • syllibut was axeBpllfled by tht sc«nS^rlo of the previous 
chapter. The Coach assuliad that th«^ nonoptlai^l jaove was due to lack of 
'fMlllarlty with the DouUe Eviderict probability rule However, that rule cannot 
b« properly appllfd lAiless the necessary logical deductions' re;iardlna th« 
available evidence ^reuiade. pierefoire. for ^ player whose experience end/or ag* 
places hla early In the syllabus, the loflicaj rules would J»e the preferred toplV 
of conversation. Th* scenario involved a Mre advanced player, who had^elretdy 
.Mastered logical rules; hence, \he coaching focus was on^ the next topic of 
the syllabus — the probability rules. 

Creating sufe^ets of the Exp^t-'s knowledge is straightforward: deciding on 
useful slBplifications of various rules is aore subtU: This is true for the ' 

traditional educational setiing as well a», Tor a Coaputer Coach. An exaaple of a 

_^ u,^ . 

rule iliplification is as follo*»s: Suppose a rule has certain exceptions, /l^ 
reasonable prdagog9bal siaplif ication is fpr the Coach to ignore these 
exceptions, until the novice player has aastered' the exception-free 
approxiaation. For Wuapus, a-typical slBplification- of this kind is to assuM 
that a given warning is caustTd by only a single danger, m aore subtle analysis 
needed to deal coJ-rectly with the existence of aultiple dangers of each type 
(i.e. Mltiple bats, pits and Wumii) is for a later stage in the- syllabus. 

Since s iapl If ication Is a critical ability, the 
investigation of general cpttfFla.for sinplifylng a rule-based * 
expert to yield a syllabus becones an iaportant jjoal. One, 
candidate is to simplify propositions of the fora "A and B" . "A 
or B" or "B '> A" as "A". This general scheaa produces the 
sUplification of assuaing that a single danger is responsible 
for Bultiple evidence. Uork by Ruaelhart [1975] on 
suBMrization rules for stories suggests that the slBplification • 
rules proposed here (which are siailar to his rules) have 
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psycholoBlcal validity in terns of Mow people simplify and 
reaeaber descriptions. ' 

, « 

mcoach will take advantage of slBplified subsets of, the Expert's rules In 

four ways. The first Is to for. "Simulated Players' froa these subsets. These 
woyld represent averag* players at various stages of development. Simulated 
Players would augaent the Expert by provldlrifl a source of expectations for 
student- level performance. The Simulated Player would' also represent a target 
knowledge state for players at a preceding stage in the skill acquisition 
process. • Figure 4 Illustrates the augmented Computer Coach. 

The second vise of slmpilficatlon rules is to derive variations on the Wumpus 
g«M as intenNdiate coaching environments. Such variations , can be obtained by 
changing the number and type of dangers, tha^dlstance from which they can be 
sensed, the number of caves and the topological restrictions on the w«rren (i.e. 
^ • general three dimensional maze at ^ne end of tite spectrum to a 2 dimensional 
rtcttngular grid at the other). Versions differ in their complexity and the 
skills they require; hence good coaching includes the capability of suggesting 
the appropriate variation to a player, depending on his l%vel of skill. For 
•xaaple, the following sequence of successively more complex variations might br 
us^d by the coach: 

1. (single, static dangers in constrained maze) Wumpus with only a-slngle danger 
, - Of each type, played on a rectangular grid. 

2. (multiple, static dangers in constrained maze) Multiple bats and pits, but 
only a single Wumpus, again played on a rectangular grid. 

3. (multiple static dangVs*in a general maze). Generalizing the qrid to efi 
unconstrained maze with limit on the branching factor at any cave. 
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4. (dynamic dangers) AllwlnB the Wuopus to move, If the Player shoots at it and 
misses. (Recall that the game is won by shooting an arrow into the Uumpus* 
cave.) This requires the player to understand how .old evidence degrades in 
• this situation. * - 



.5* (competing goals) Playing the game under a time constraint results in th« 
' subgoal of visiting the nearest neighbor to obtain new information competing 
With the goal of rNajfs visiting the s?lest cave, no matter how far away ^ 

) 

A third use of simplification kno"Wrtdoe relates to a theory of player bug«, 
/^^ A player may possess a skill of the Expert in some approximate form that leads to 
bug* in certain situations. For example, the player may havl formed an Initial 
••t df skills for Wumpus that never consider multiple dangers,! but instead assum« 
that only a single pit or bat is responsible foV adJaceiV warninfls . Ih the 
^scenario, this would permit the incorrect deduction that cave 14 necessarily 
^ > contained a pit. (See again figure 3.) Proper modelling requires the Coach to- 
j;«<;ogni2e that certain clauses are missing in the simplified logical rules 
possessed by the player. This can be done by checking whether a known 
simplification leads to behavior similar to the player's. In this case, the 
simplification discussed above involving approximations to rules obtained by 
dropping e;tceptions would produce- a Simulated Player version of the Expert that 
« Birrored this behavior. Thus, the simplification rules lead to a theory of 
"developmental bugs*, namely those errors that arise diie to rational 
slmpUflcMlons of complex skills that arise as natural stages in the fearning 
process. Sensitivity to this can allow the Coach to* discuss the player's 
ptrfoniance not as an outright error, but as a aiiplif icatlon inappropriate for 
■ort complex situations. . - ^. 

A fourth use of simplification rules in suomarizing a complex explanation 
for initial presentation to the player. This topic 4s pursued in thd^^^tion. on 
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titoring. 



To concludt, htving a 
iltaDlt stqutnca pf siap 



tylltbut raisas two istuas.. Tha first is whathar a 



sultabla saquanca pf siaplifiad gaats sight aliainata tha naad for tha coach 
antiraly. Our ^liaf-^a* that tha choica of a siaplifiad gaaa facilitataa 
laaming by tha playar, but doai not oliainata tha naad for tha coach. Tha 
cannot ba Mda to stasia that no difficultias for tha playar arisa, alsa tha gi 
if no longar anjoyabla; and^ at long as siich difficultias axist, tha utility for 
tactful tutoring whan thay occur roMins Important. Furtharaora, tha siaplif i^^^.- 
gaM Mlias aodalling aasiar axactly bacausa thara ara fawar skills potantially 
baing aaployad by tha playar. Still wa considar tha utility of tha Coach 
ultiMt|^ to ba an axpariaantal hypothasis that raquiras validation. Ona 
control on aaasuring tha ^utility of tha Coach will ba a comparison of tha rata at 
which skill is acquirad with playars who do not^ava accass to coaching: (Thla 
is discussad in tha plans for our axporiMntal prognai in chaptar 4.) 

Tha sacojiit^ssua is whathar tha syllabus i^ilias that all^ playars acquira tha 
skill in axactly tha sasa fashion. This is not our approach « Rathar wa think of 
tha iyllabus as a ganaral plan for ths Coach that is adjustad particular 
playars on tha basis of their currant knowladga state. Indaadiil^wladga and 
skills ara not linearly ordered and we intend to structura tha various 
constituent skills of the Wuapus expert into a partial order (on tha basis of 
praraquiaita^-ci^ist^aints). It is the Job of the tutoring sodule, in discussing 
issues with tha player, to decide on what nath through this natwork to taka. 
This parsonelizition is based on a consideration of the structure of tha syllabus 
and of Aha individu^lHyiowledge state of the player. We tlisc&ss the Tutor balow, 
iHttNTirst an analysis of the pre-requisite aodelling capability is raquirad* 
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2.3 Tha Piayr Knowladfla Hodal 

Succassful coaching raqulras a MHal pf thp playar's currant skill.. For an 
Intallactual gaaa of tha kind wa ara analyzing hera, a aodel of the user's 
knowladga can ba constructed as an ooerlay on the Expert, I.e. as a sat of 
hypotheses regarding the relation of the player's knowledge to the Expert's. For 
each ruUp the overlay provides probabil|/ties that indicate the systeo's measure 
of confidence in the three alterati^: (a) that the player linows the rule» (b) 
that he knows ^the rule^n sqae sSdified form (for example without knowledge Ir 
its excepti^rts)p dr (c) that he does not know the rule. 

In soM situations t it may be preferable to generate the Knowledge model as 
an ovorlay on a particular Simulated Player (as we showed in figure 4). For 
example, if the flayer is known to be a beginner, then typicalTy he) possesses 



knowledge of the ^og^lcal and probability ruies in a simplified form. So 
modelling can begin in terms of a Simulated Player with these characteristic^. 
From this perspective, the Simulated Players can be viewed as average players at 
different levels of sl^fll^ ^ This approach allows tutoring to take initial 
advantagf of the coarst'^ model provided by the Simulated Player, until a more 
detailed assessment of the player cain be made. 

The use of coarse models of average players was explored in our early 
implementations of a Wumpus coach and found to be a profitable first step toward 
persohaliiation. A limited ability to make dynamic refinements of this ^initial 
coarse estimate usiAg impUcit evidence from the student's play is present in 
Carr*s WUSOR program. However, a lexicoit of Simulated Players representing the 
student at various poin^ts in the syllabus has not yet been studied, nor has 

overlay mdflelling been test^ed in this context. 

I* 

ZA The Psychologist . 

To generate and maintain a player Knowledge. Bod^l, a modelling cc^onent in 
tlia Coaclr Is required. Va call this aodule the ftycftoloffit (figure S).- This 
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FIGURE 5 - THE PSYCHOLOGIST MODULE OF THE COACH 



' 1 



ERIC 



C(»puttr Coachts \ 31 Ira Goldstein 

Mdule is responsible for generating hypotheses regarding the player's knowledge 
on the basis of evidence arising fron Cd^ithe player's behavior In t»he gane, (b) 
his explicit questions and directions to the Coach, and Kc) the long tera aodel 
of the player's position in the syllabus. We plan to inpleiient and experiment 
With Jk modelling coaponent using these criteria. 

Thf fundaMfittl ^ind of evidence arising froa the player's behavior is th« 
difference between his answers and th^se of the Expert. The Expert is able to 
•xplain what rules were involved in deteraining a given aoye. The^ Psychologist 
observes the difference in rules between those involved in the Best aove and 
those involved in the player's choice. The hypothesis is that the player is 
unfware of those rules which would differentially involved in aaXing^ the 
unrecognized better ic^. As an exaaple, in the scenario given in the last 
chapter, the Psychologic would have 'considered the sove to cave 14 evidence for 
Increasing .the estlMte that the student is unfaailiar with the Double Evidence 
probability rule. 

Such evidence can be Bisleatilng. The pfayer My have known the rul4^»-but his 
drawing, of the warren was sloppy or Incomplete, and hence ^e was unaware that the 
rule applied. 9r perhaps the player has chosen to play quickly, and for that 
reason is not engaging In careful analysis. Henca, the Psychologist aust deal In 
probabilities, not certainties. Furtheneore, it will be important to allow the 
Psychologist to affect the version of the] gaal being played, in ord^r to create 
situations where it will be easier to decide if the player has a particular 
skill. For exaaple, the Psychologist sight direct ^he Coach to provide a display 
of the explored caves in-order to insure that it is not a faulty sketch that U 
causing the difficulties. 

Since we envision the Coach being used by a player over Vong periods of tlM, 
It will be important to include a forg^ifulMess factor, i.e. for the Psychologist 
to decpi^asf the probability that the player knows a skill if it has not been 
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•XTCLad ov.r . Ions p.rlod. Or Vrh.ps ^ «y wl.h to h.v th. Co.ch glv. th, 
pUytr •w.r.-up .x.rcl«.«- who.. «olutloiH*lll yi.id ovid.iic. ,n l.o« .uch th. 
PUm hts r«MA»r.d. An .x.^»i. of such u oxorcl.. .ight b. to pr.s.nt th. 
pUy.r with fiflur. 3 .„d ..k hi. to U.t th. thr.. po««lbl. .ov.. m ord.r tf 
Incr.asing danger. 

Th^ narrow boundarl.a of th.' fla.A .ak.« it poaalbl. to approach th... 
cult qu.stlons. Th. d.slgn. tasting «,d (ta^uBglng of alt.matlv. ifod.lUng 
strataglas will b. an important dlMnslon of this ras.arch. 

2.5 Tha Tutor 

— 

Succassful axpartls. «,d «>d.l ling will b. of no avail un'l.ss th. Coach 1. " 
co.p.t.nt in d.llv.rlnB .dvit.. Whll. w. cannot approach th. kind of ..path, 
th.t vean aklst b.tw.n hu.an playar «,d coach, w. c«, attipt to 'glv.' th. Coach 
so.. fl.xlblUty Its ..thods for discussing particular Issu.s. Thi. 
capability r.sld.s In th. Tutor «»dul. of th. Coach (figur. 6). Th. Tutor u... 
.vld.ne. fro. th. playr knowLdg. and Laming ^dals as wall as fro. th. Ixpart' 
to fluid, th. tutorial Int.ractlon. How th.s. sourcv of .vld.nc. ar. us.d by th. 
Tutor and to what ands Is th. subjtct of this section. 

Th.r. ar. thr.. dL.nslons to g.n.ratlng an axpianatlon which .ust b. • 
co«.ld.r.d^by a Tutor: th.se ar. Ohat to say; (t) Whan to* say It; and (c> 
Vkm to iiy It. 

y 

^ for tl,. coach. mh,t to s.g is a function of th. dlff.r.ntlai knowl.dgt 
(call.d th. to,lc-.^.t) b.tw..n.th. .ov. th. playar .ad. and th. b.at .ov. 
•vallabla. In th. .xlstlng WUSOK progr... th. Exp.rt g.n.rata. a n.l.-*.t for 
•ach posslbl. «,v.. Th. n.l..s.t. consists of thos. rul.s inyolv.d In co.puUna 
th. probability that a giv.n cava contains a dangar. 

This quality of b'.lng abU to .xplaln Its d.cUlonsI Is s6 
crucial to all Exp.rt progra. b.lng'us.d as part of a tutoring 
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FIGURE 6 - THE TUTOR MODULE OF THE COACH 
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jyittB that wt call it tht irliicifU 0/ artlciiUtt exftrtije.' 
Ito chott i rult-Nttd approiCh to rtprtttntlng txptrtist btcaust 
It hit this ••rticuUtt" quality: tlii forMl txpltnition pf the 
probability of tht'dangtr of • givtfi civt is t list of tht nilts 
n«id«d to coapytt that probability. Tht areatft prtMfittd In tht 
^ scenario was obtaintd tsstntially by noting tht rults nttdtd to ^ 

dtttraint tht dangtr of tht various possiblt aovts. 

J*. ' . . 

• % * 

.T1i« WUflOR Tutor theq coaparcs nht riiU-sct of the bcst-Bovc cave (i.e. the 
cava with tht lowest probability of dangtr) with tht nilf^stt of tht cava chosen 
by the player! The differeoce between these nilt-seJts is the toptc*3et: the set 
of rules that are reasonable candidates to discuss with the player. The 
educational hypothesis here is: if the player knew the rules in the topic-set, 
then he would haVe been able to coapute the correct probability of the best Mve, / 
and hence would have chosen. that cave; For the scenario, VUSOR would haye 
generated a topic-set cofitoining the doubli evidence rule along with several 
othfr topics. ^ , 

^WUSOK prunes this topic-set by tliulnating those rules that its Knowledge 



WNlel indicates are already known by the^player. (It was on this basis that the 
logical rules were pruned by the Cpach in the scenario). A coBplesentary 
lagfovetMnt is achieved by comparing tht reMining rules in the topic-set with 
the Syllabus. A particular topic is chosen by selecting the rule of the toplc<^ 
set nearest to the player current position in tht Syllabus. (-In the scenario, 
this Was illustrated by the Coach choosing not to discuss the choice of Bove 
quantitatively. PresuMbly the player was not far tnough into tht syllabus to 
Mrit this ltvtl^dV4liscussion.) Thiis. as in huaan discourse, knowing 'what to 
say* is Improved by having a better understanding of your listeoer^ 

We call this approach/to* topic selection /roatter tatoriag^ Figure 7 
illuntj^tes the origin of this phrase. The network of nodes represents the 
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syllabus, with concapts incraasino in difficulty froa laft to right and linkad by 
d«Mndancias. Tha.shadad raoion raprasants' tha' subsat of tha syllabus knom to 
tha playar. as indicatad by tha Rnowladoa aodal. T^r^rkanad nodes ara tha 
unpnmtd tOpic-Mt. Tha frontiar consists of 'thosa nodas on tha boundary of tha 
thadad region. Tha preferred choice of topic are tha topic nodas in tha 
unaxplorad region of the. syllabus closest to the frontiar. COACH-1 will a^>loy a 
slailar st^ataoy. augaanted by the Siaplif icatlon rules and Rhetoric rules 
outlined later In this section. 

The coathing paradiga also suggests vAeji to engage in tutoring. If tha 
player aight have aade a better aoVe. then he will pften be interested iii luiowlng 
this, in order to i^rove his play. Hence Tutor engages in a discussion with 
the player about the underlying rules when their availability would aaka a 
dlffertnct to tht pliytr's dtclilon. Tht Tutor 't^Tiwil it to convty t^|i« 
onderlyina knowltdge: tht play«r*s is to btcoM an oxport it i g«M h« Mjoys. 
In tht Wimpus sctntrlo prtstnttd ttrlltr» this was lllustrattd by tht coach using 
tht Bovt to tht dangtrous cava 14 as an opportunity to discuss tht *doublt 
tvidtnct' hturfisiic* This and txamplt oritnjttd tutoring fits within the 

paradi(p introductd by Burton and Brown [1976] for an arithattic gaM calltd HOW 
THE, WEST WAS WOW, originally dtvtloptd for for tht. PLATO EltMntary NathtMtics 
Frojtet by Bonnit Andtrson. 

Howtver, tht rtstarch propostd htrt txttnds Burton and Brown, (as wall as tht 
existing WU50R prograi), by considering the procedural fonwlation of a broader 
set of explanatory techniques. For exaimle, it is not enough to have an issue to 
discuss and an exaaple to illustrate it. Care aust be. taken to control the 
length >f the explanation. For this raason. we plan to aake'^siaplirication rules 
available to thf Tutor for sinaariiing explanations. Exaaplas^ara: 

51. Simflift 'A fcaMS9 t" bt A. 

I. 

• / # 

er|c 
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' ' r- ■ 

52. Simflify 'Kx) *> Kt)' by Kt). ^ 

> 

Sa. SimfliJt^ 'A A (A *> B) '> r Ay B. ^' 

These rules art suggasted by work of Ruaalhart [1975] on the suBaarizatlon of ^, 
storits. Thty ware introduced eerlier for c^eetlns Siaulated Players by 
siaplifyiDg the Expert's rules. 

To Illustrate their application in this context, consider again Vl\% scenario/ 

/ 

In our proposed design, the Tutor will generate a coaplete^ explanation 
internally, which we shall call the Agenda , and then apply the sinplif ication 
rules to select the appropriate reaark to be Mde to the player. 

For exaaple, in the scenario, part of the agenda for the cave 14 double 
evidence explanation is: 

1. Tkffn is double evltfence ihut cere 14 coNtalNS o pit. 

2. FAere Is single evltfence that cove 0 coNtolns e pit. 

3. Stifle evltfexce Is st/er then double evUence. 

4. Therefore, ceve 0 is sejer then cave 14. ^ ^ 

tfe have given the Agenda in English, though it would have a foraal internal 
representation in the Tutor. Also it is incoaplete, since there is no discussion 
^ the other dangers. Applying the siaplification rules, the tdtor's fomal 
response to a Mve to cave 14 would be its conclusion: Cove 0 is sefer then Ckwe 
14. (In the scenario, the Speaker has applied ellipsis^ generating the 
abbreviated reply: Ctve 0 is st/er.) 

Of cpurse, the player My desire Aore inforsation. Hence, as'we indicated In 
the scenario, it will be possible for the player to ask questions, with the tutor 
ansifering by supplying Mre of the Agenda. We call this approach to providing 
advice i tfiscoarse tkeorg o/ expUJiatioN to emphasize that an explanation is not 
ii lecturet ^t rather an interactive dialog betMen Coach and player. We return 
to this these when w« introduce linguistic discourse rules las part of the 
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SftMktr's cipabllltlts. 

^ Wt hava contldfr^d "ukat" and *^m" to coach tha playar. Thera Is still tha 
dlMaalon of "how* to forwlata an axplanatlon ragardino a particular' rula in tha 
toplc-aat. Collins [1076] has fonwlatad as procadural rulas- a variaty of 
^^Bocratic tatorlng tachniqaas. Tha rasaarch proposad hara axtands this taxonomy. 
Ua propoaa to davalop procadural tutoring, tachniquas that fall within all fo«r of 
tiM following catagoriaa (although our laxicon of tutoring tachniquas for aach 
Mtagory will carUialy not ba axhaustiva): 

!• loftcal ejcplaaattoii: tha ibst coaMon exaapla would ba citing rula plus tha 
currant^ avidanca and drawing tha corract infaranca. Tha abova aganda for 
axplaining tha dangar of cava 14 was of this foni. ^ 

2. Vfpbtkatlcal^flaaatioiis: tha ust of a supposition in davaloping'^an arginant 
would ba atlowad hara. As an axanpla* supposa tha coach is trying to axplain 
that cava 2» a naighbor of cava 1, is safa froB bats bacausa 1 contalnad no 
squaaks. This is, in assanca, totoalng tha logical rula, *If a cava doas not 
contain a warning, than ab naighbor contains a dangar." A hypothatical 
axplanation would ba: . 

Ufpos9 C99fi 2 coitataatf a Act/ then me mould kaaa keeri a 
Sfueek in eaaa i. Bat we iU not. So cava 2 must bo aa/a 
from kot$. 

3. Ororkieol Bxflonotionsi this is rsally another diaanfion — a .logical or 
hypofhctlcal argiaent can b« given In English or via pictures showing states 
of tha warran. Flgura 8 Hlustrates a series of scenes on the TV display ttiat , 
parallal tha preceedlng hypothetical argiaent/ 

■ 1 > ' 

4. CoWrata tjtHanatto»Mi this category would include explanations* orlantad 
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figure 8 

Graphical- ExPLANAT-iof^ of 

"If A CAVE DOES NOT CONTAIN A WARNING, THEN NO NEIGHBOR CONTAINS 



A DANGER, 



1, Suppose the Warren 'looks' lik^this : 



1 

f o o\ 



2. Then you woul^ hear a squeak. 





' 3. But, 




NO SQUEAK 



^Ir Therefore, 






V 
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around sptcific^ txaiwlts rithtr thtn rules, Itiving it to tht pUyor to Mkt 
tht no^siry gonertiizitions. Tl|t siaplifUd initiil coaching to the ^udtnt 
- in tht cast of tht cava 14 ts^lt rtsulttd in tht concrttt rtMrk: ''Cava • 
is sa/ar tJkaa care 14.** Only upon optional liubsaquant questioning wat tllf 
explanation raised froa the concrete. to the abstfactp with geiferal^ principles 




In essence, these explanatory techniques are a procedural theory of rhetoric. 
The word lias acquired a negative connotation of "undue use of exaggeration or 
display", but its classical Maning is 'the ability to use language errectivel]^..- 
We have generalized rhetoric to apply to graphical is well as linguistic 
explanations, but otherwise w^^^re engaged in the classical study of effect i¥a 
• cpHBunication for the purpose'^of conveying an explanation. Without rhetorical 
skill; a tutor, whether hunan or Mchine, will not be effective. Our concern for 
■Ultipla explanatory devices is one of the qualities that distinguishes this, 
^ research tttm classical frsM-oriented CAI. 

Civen a catalog of possible explanatory strategies, the 'l^tor* aust select a 
particuly^stratedy for a player at a given stage af dave^opsent* accomplish 



I, th^^ach^eBj 



this, the^TMch^Mpley^ a Player Learning Hqjfil. 

2.6 Tlie Player Learning Hodel - ' | 

r Therj are Mny dimensions W-a.player*^^aming benavior, but the slice that 
is pragMtically useful to the Coach is the player's preferences with regard to 
the tyai liable tutorial iodes. The Player Learning Nodal is an owerlay on the ^ 
Tutor; specifically, .four nuaerical weights are associated with the elach • 
^ tutorial strategy which estiptfte whether: 

(a) the player is known to prefer that strategy; . ^ 



(t>) h« is known to dislike ft; 



(c) the strategy has been recint^y used; 

^ — It 
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(d) the strategy^has been successful as Judged by subsequent play. 

We introduced the Psychologist sodule of the Coach earlier , describing its 

generation df the X Model. The Psychologist is also responsible for generating 

md Mintaining thiM flodule. The kinds of evidence we plan to use are (a) 

(fhefher a given tutorial technique on the average c^sults in the player 

successfully acquiring the rule^the Tutor is trying to convey, the player's 

explicit reactions to a given tutorial technique (e.g. "I don*t understand!') 

and (c) general knowledge about the relative success of different techniques for 

various kinds of tutoring situations (erg. abstract explanations are probably not 

preferable for young players or those not aatheiiatically trained). 

Xh^ Tutor will adjust its explanation of a given rule on the basis of the 

e 

Learning nodel, although this does not nean that the player's preferences are 
always followed./ For exanple^ the Learning nodel night reveal that the player 
has becoae too dependent^ as evidenced by always deaanding a conplete 
expi^anation. In such cases» the Coach would choose to refrain from providing the' 
complete Agenda* despite the student's desires."" 

' Successful modelling or learning is dependent on succeisful aodelling pf the 
various ki^ledge states the playtfr passes through. Hence, our initial research 
Will focus on generati?ig* the overlay aod^l of the plAyer with respect to the 
Expert (i.e. the ICnowledge Hodel) to be followed later by an investigatioi^ of 
•modelling the player's interaction preferences as an overlay _on the Tutor (ife. 
the Learning Nodel). . ^ 



2>7. Ttie Listener 

The coteunications nodule consis/1 0/ two cdnponents; a Listener for 
translating questions by the player into a font coaprehenslble by the Coach and ^ 
Speaker^or translating the selection iof a fornal topic by the Tutor into a 
comprehensible fora for the Player jtfigure 9)^ In this section, we^discuss the 
Listener, and in the next, the Speaker* 
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. ' \ 

Progress Ini^AI offers the possibility of coafortable EnoHsh comprehension by 
-the Coach for restricted doaains. as illustrated by 'the SHRDLU [HinoBrad 1972] 
and LUNAR [Woods 1972] proBraai. The gse of senantic Brannars in Sophie proved 
this for the electronics arena [Burton 197,61^. We propose to ipply this AI 
technology to the coMunlcations interface with the playef\ to the end of 
iaproving the systea's sensitivity to the player's reasoning. Ideally, we would 
like to be able to ask the player for his explanation of why he made a particular 
^ve. How far along the spectrua ofriiqces'sful natural language comprehension we. 
cfl^ reach is uncertain, but available AI technology will allow- us to achieve 
qualitative iaproveaent over previous coaputer assisted instructional 
•nvironnents % 

There is another possibility for ii^ut fro« the*jjprer to the Coach the 
use of a tablet, to suRport" graphical ^puti, We partly avoid the .need fpr 
graphical input 1>y having t>ie Coaeii^ulntain a graphical display ef the explored 
warren on the TV. but ideally the, Pl^^r should bejillowed to aaintaiti his own 
pictorial representation. If purely' linjtftstic input proves too constrictive, we 

will add a tablet input module. Mop^. by [Negroponte 1971, 1974; Herdt, 1975; h 

1 " 

Purcell 1976] indicates the possibility of achieving^ significant power in this 
dlMnsion. * 

2.S The Speaker \ ^ 

The Coach will also use English in its explanations. An ability to/ speak 
succinctly is critical if the interaction is not to be excessively tedious. We 
have already'^exaained ei^teria by which the tutor can select the content of what 
it Wishes to say.^ But after this has Jbeen done, thefe remains conversion of the 



\ 



conceptualization to English. 

*^Our goal is to develop a 'discourse oriented theory of explanation'. Hence» 
wf propose to eabbdy in the Speaker: various linguistic conventions for 
facilitating discourse. One such linguistic device which allows brevity is 
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•jiff*orf» tht us« of pronouns to rtftr bick to prtviously introducod 



objiftt. An nxMpU is: 



ro^ wisited cfve 16 e^rlUr. Coe 15 is « A«/e c«fe. 

rtductd by antphora to 
Ton wUitti c«fe 16 Mrlier. /t t4 at/t. 

Anotbnr linguistic dtvico is ^llifsis, not including a givtn. phraso b«causo 
tho Cqach can pssuM tho playor alraady has tftat knowlodgo. An exaaplt is 

^ *^o« Aift krea ia Uio af<fAAor< o/ caat 14 aa< loa /tit a tfra/t 

ta >oti> neiikborT oS^14 . 

raducad by allipsis to 
^ fott Aaae Aeea ta t«o aeifAAori o/ caae 14 aatf /ett a tfra/t ta 

Aot»: . , . ^ 

Workmen ganaration [Siaaons 1973; HcDonald 1976] suggasts. that it is a raasonablt 
goal to includa thasa capabilitias in tha Spaakar in a aodast way. 

Tha {(paakar Modula is also capabla of ganarating graphic » as apposad to 
linguistic axplanations upon tha Tutor's raquast. As tha doMin of discoursa is 
a vidao gaM, this is assantial. Thus* tha tara Spaakar (and Listanar) la baing 
usad in ganaralizad fors to apply to all cowunication channala batwaan playar 

and Coach. ' ' . ^ 

y , , 

2.9 Suapary 

To suaaiariza our dasign for a Coaputar Cokch, axaaina again figura 1. Tha 
Psychologist aakas hypothasas ragarding tha^ playar *s stata with raspact to tha 
Expart*s knowladga and tha Tutor's axplanatbry tacTiniquas. .It doas this using 
avidanca froa (€) tha playar *s parforaanca as analyzad by tha Expart» (b) his 
.axplicit instructions to tha Coach and (c) tha axpactatians of tha Tutor. ThaM 
hypothasaa fora tha Knowladga and Laaming aadaly. Tha Expart Indicatas whan a 
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pottntlAl tutoring situation has arisen by inforaino the Tutor that a nova is 
non-^ptiaal. Tha Tut^r uses thV analysis of the expert and the content qf the 
■odtls to dtttrmina- what topic is appropriate to discuss with the player and in 
Mhat fashion. A natural languaoo -interface » the Speaker and Listener, serves to 
iaprove the coMunication between plaiy^r and Coach. Siiulated Players ere 
simplifications of the Expert which sore accurately Bodel expected performance of 
the player. 

The design of Computer Coaches is more than an exercise in computer 
programBino: it addresses fundamental questions if( education. For example » four 
major theoretical goals of this research are to develop and test: ^ 

1. an articatete model of expertise that supports modelling and tutoring by 
providing explanations of alternative decisions that can be made in a given 
task state. Our approach is 'to use a ruie^based formulation of expertise, and 
use traces of the rules required to iMke a given decision as the explanation. 

2. overlef mode lUaf which describes a player in terms of the capabifities of the 
Expert or a simplification of the Expert (Simulated Player). Does the overlay 
model improve tutoring? Can predictions be made abiout the performance of the 
player 7 This goal is similar to that of Newell and Simon [1972] when they 

^eek to construct production systems that model an individual. 'The new 
Ingredient proposed here is the use of a coaching environment JLo ohtain 
evidence and test success. 



3. a tftscoarse orienterf theory o/ ekpUnatloji in which a frontier model controls 
topic selection and a catalog of rhetorical techniques determines the form Of 
the message. The Knowledge model, the Learning model, a net structured 
syllabus and an articulate expert all contribute to this function. A Speaker^ 
component converts a formal message into a user*comprehensible form, applying 
tettll further discourse rules to obtain conciseness. Progress in this 
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\ 

dlrtetion will bt an iMortant tttp Jtowardt a procifdural tht ory of 
•xplaaatioii. 

4« rml9S of Jtvf M/<c«ttoji that can bt ottd to organlzt axptrtist «lnto a 



tyllab«f» doflnt restrlcttd tasks for tht playtr as txtrclsts» and SMsarlit 

r ' 

coBpltx tvl^natlons. Tht fact that this thtory of slBpllflcatlon JlBds 
■ultiplt applications^ rtlaforcts oar btlltf that tht computational tnvlron— n t 
of tht Coach touchts dtoply on ctntral Issuts In tht thtory of ptdago^. 

Iff txplorlng thtst goals, wt art dtvtloplng a iitntral thtory of coaching that 
applits not only to tht playtr of a gwt, but, In gtntral, to a novlct tngagtd In 
my task iditrtln tht sk^ll can bp aodtlltd by rults. 

Thtrt art, of courst, lialts to tht psychological and tducational^-outstiofis 
discusstd in this proposal. Vt bavt not, considtrtd,' for txiBplt» such issuts as 
playwr/coach tapathy. This arists i4itn «t coniidtr «4itthtr tht Coach should ba 
allowtd to alttr tht location of dangtrs (consisttnt with tht cluts givtn to tht 
play«r so far) to rtinforct its advic*^.- This ability aii^t bt ustful^Mhtn tha 
Coach warns tht playtr that a aovt is nonoptlMl, but tht playtr Mvts thtrt 
anyway. If tht dangtr was not actually In tht high probability cavt» should tha 
Coach alttr tht gaat statt so as to position tht dangtr thtrt 7 (For txaaplt» if 
tht pit hid not boon in cava 14 in tht sctnario, and tht playtr had aovtd thtrt » 
should tht Coach aovt tht pit to that cavt.) Miilt this night rtinforct tht 
Coach's advict, it risks losing tht playtr *s tnjoyntnt of tht gant. Tht Coach 
would probably b« considered • *ch«at«r' If the playtr knaw of thasa 
rvarrantpatnts. But, should wa allow the Coach to hava a dasli^ that /Mist ba kapt 
lilddan froB tha studant7 Wa ara not sura about the relative aerits of thia 
particular tutoring ability. (It can arise In an Intariedlata fora If wa allow 
tlia Tutor to advise the Qaaa aodule on the positions of the dangers for tht new 
». b«t prtvtnt any alterations once the gaaa Is begun. This would probabably 
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b« considered f^ir by the pUytr.) Wa pUn to study the •■pathetic relation 
between Coach and player durldg the experlMntal phase of this research, and 
incorporata lAatavtf Inslgbts are obtained into <he design. 
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3. Tttltvat M— rdi ' ' 

' • 

^ a«ctiM 3.1 dttcrlbtt tkt coipittr eoMh u t MUral tvolntlonary sup UC 
^tMpiKcr AMltUd iMtnictiM, r i d ylng mm of Its Mjor dsftctt of tht p—% 



and tfrawlag m mm of its strMftlw. Thli tUp Is Mdt possiblt by: 



1. TiM appl^^catlM of •rtlf'lclal laUlllotoc* tbMry Md ttdwolofly to the doslgn 
for tM coach (soction J.tjr. ' . ' 

t. Tli« «st of UforMtloii procottlns ptyciiology tochnlfios to aodol yrobloa 
tolvlAO la Urmt of nit s«ts (Mctloa 3.3). 

3. Tilt dtcllKliifl cost of coapoUtlo« (MCtioo 3.4). 

3ti Co»ottr Aiilitod Initrqctloo 

To too tht pltct of Ut Coaootor Cotdi lo CAI, It li ottful to cbtrtctorlso 
CAI im torB% of foor porlodt Uigtrt 16). Tlio flrtt. wlilcb «t btvt Itbtllod tho 
Primiti99 ftrtotf prtdtttt cosyottrs ttd rtprtttott tbt orlgiotl work with 
proffrtMod Ittrnioo ttxtt. At tht tiat this Wrk wts undtrtthtfi, both tho 
t#chiiology «id tho cognltivt thoory wtrt in « prlaltivt statt, 

Tho itst of coapottN^oltUttd tbt ntxt Niast wklch wo ttni ^bt CltJ^fctt 
fortod. It occopltd soft of tbti sixtits tod t¥tn today roMlot tbt doaloont 
porodlQB outsldt tht rtstarcb W^ronatnt. frogrmt dtvtlopodj wl^in this ora 
woro typically organUtd as a dtclslm trtt of Mltlplt cholct qiitstions» -with 
tht stodoQt*s rtsponsts dtttralnlog which ptth In tht trtt Is taktn. Thtst CAI 
provraas wtrt tht first txploratloas of tht coaputtr as An tducatlonal tool. 
Tlity woro lo ^oat casts ablt to provldt Inttrtstlng Itamlng ofivl r o iw i tn ts, for 
oxasplo tht choalstry prograas of PLATO [Bltztr and Johnson 1971], but woro 
ultlaatoly llaltod by a alniaal ondtrstandlng of tht'problta doaaln bolng tought, 
aad alaiaol aodols of tk% ttachlng and Itamlng proctssts. Tht ^^adlgp of tho 
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classical pariod was to dsvslop tutor languages to faCilitata the desigfi of 
scripts by teachers for their doMins. Such an approach to CAI reaains useful In 
certain contexts, but to achieve a new plateau of perforaance, a new design 
philosophy is nscessary. 

the rtomhtic Period represents the shift to i nwH piridigii in which t»rOlotl , 
Is to oobod gonaine doMin expertise in the CAI prograa. Three benchMrk efforts 
in this category, each concerned with a verir different kind of expertise, are the 
Logic and Set Theory tutors constructed J)y Suppes at e{.; the geography tutor of 
Carbonell and Collins; and the electronics troubleshooting tutor of Brown et ai. 

* Suppes has been involved with CAI since its inception, and hance his work spans 
the classical and romantic periods. One of his long standing goals has batn 
the development of a proof checker capable o^ understanding the validity of a 
student's proof. With the gradual evolution of AI techniques, he and his 
colleagues hava been able to evolve suc/essfully sore powerful proof checkers 
[Suppes 1972, Goldberg and Suppes 19^, Saith et al. 1975]. Thus, In this 
case, the research represents an evolutionary rather than revolutl^ary 
transition froai classical to expert-based CAI. ^ 

* Carbonell designed Scholar around 1970 as a CAI systes for geogr^ph^^at could 
answer as well as ask questions. The basic theoretical isproveMTTwas the use 
of a seMcitic net, a doainant AI representation, to represent dosMin knowledge. 

* Since that tiae, Scholar has evolved as a result of the later work by 
Carbonell, Collins and others [Carbonell ft Collins 1973, Collins et al. 1975^. 
The prograa has served as an iapetus for iaproving the power of seaantic nets, 

and hence has had iaportant feedback into AI research. 

\ 

* Brown's SOPHIE systea, a Sophisticated Instructional Environaen;t for tMtoring 
electronic troubleshooting, is iapresslve in terar^of its level of doaain 
expertise [Brown et el., 1975]. The prograa is capable of siaulating the 
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^ Internal behavior of a power supply, and hence can answer most student 

questions regarding the state of the device. 

Th«s« prograas, soaetiaes called Generative C^I [Bryan 1969], nade possible a 
new level of perforaance. Such CAI tutors are not Halted to comprehension of a 
highly restricted set of student i:esponses; but, through an embedded domain 



Expert, are able' to comprehend a much wider set of interactions. They were 
originally romafftfc tjjorts in that the AI technology, of the late sixties 
necessary to implement Expert modules was itself in a relatively primitive state. 
But during the last six years a progressively more powerful set of AI tools have 
been developed and applietKto embedding expertise in CAI programs. This 
evolution began with the original use of semantic nets in Scholar, followed by 
thm use of semantic grammars and multiple representations of knowledge in Sophie 
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[Brown h Burto^n, 1975]. Brown has referred to tutors of this kind as ICAI 
(Intelligent CAI). 

Recently, a fourth phase in CAI research has begun, characterized by the 
inclusion of expertise in. the Tutor regarding t/le siuitnVs learning behavior and 
possible tutorial strgtefies . We have chosen to call this new generation of 
instructional programs AICAI Tutors, to emphasize the use of AI techniques in the 
modelling and tutoring components as well as in the Expert module. Within this 
context, Collins [1976] has investigated computet ion'al models for Socratic 
tutoring strategies. Burton and Brown [1976 a tutoring program called WEST 
hmve introduced issue oriehted models of the student's knowledge, rather then 
staple ^cords of right and wrong answers. Atkinson and others at the Institute 
for natheaatical Studies in the Social Sciences have examined the representation 
of doaain expertise as a network *^in which tasks and their requisite skills are 
represented [Barr, Beard It Atkinson 1975]. In this research, the BIP system for « 
tutoring the computer langage BASIC» a model is maintained of the student *s 
fmailiarity with various skills, and the next task posed to the s^tudent is dope 
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on tho basis of wtiich skills aro currtntly Iuiomii. 

. Tho'rosoarch «• propose horo falls within this AICAI paradlga. antbroprosonts 
an inttgratod invtstigation into tutoring aad nodalling. in which tha Bodslling 
coaponant is cencamad not only with.tha student's knowledge but also with his* 
laaming. praferances. Both the IIP and the WEST research consider only a ■odal 
of tha student's knowledge, not his preferences for interacting with the tutorial 
systaa. Tha catalog of tutorial techniques we shall introduce subsunas those 
considered by Collins. 

Of course, this division of CAI into four periods is a sinplif ication . Since 
Its inception, there has been a desire to aodel the student accurately. Tha BIF 
research, which applies AI representation techniques to the syllabus and to 
Modelling tha student, does not incotiwrate a powerful dOMjA expert (and hanca 
is liBitad in the coaplexity of the probleas it can allow the student to 
undartaka and still coaprehend the student's results). 

The novelty of the research we propose here is that in a single systaa there 
Will be significant doaain expertise, a broad range of possible interaction 
strategies available to the tutor, and a aodelling capability for both tha 
student's knowledge and his preferred aodes of interaction with the tutor. If 
this research is successfgl, the early^proaise of CAI as a por^onafT^es^^nsiva 
learning anvironaent for the student will be a aet in / rer deeper and "fora 
fruitful fashion than classical CAI of the sixties was ^le to achieve 

3.2 Coflrtitive Psychology 

Over the last fifteen years, a new ps^ho'logical discipline concerned with 
tha formulation of coaputational aodelsl of cognition has evolved. Benchaark 
texts in the field are Lindsay and^Noraari's Ikimi /n/pneetlof Proceaalug [1972] 
and Newell and Siaon's fiwmn Proxies SoUlnf [1972]. Foraclisas such as saaantic 
nets and production systeas have been used to construct procedural aodels of 
ry and of prohlea solving. This coaputational approach has proven valuable 
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la 'alucldatlno assets of husan psychology that were not adequately explained by 
the Bore static theories of the past. v 

Ve propose to apply these new concepts of cognitive psychology to the 
representation of luiowledge and learning models of the student, and to the design 
ahd iBpleaentatlon of autoaated aodelllng components. The Individual's problea 
solving behavior will be described In terms of his knowledge of a set of rules, 
where the rule^'^ Include both basic facts and control knowledge (I.e. statements' 
about when they are applicable). ^ ( 

We have j^ready done preliminary work In this area: [Hlller and Goldstein 
1976A»b»c.d] descrlbe^ Jthe process of pariTllg pregraanlng protocols by means of a 
rule-based theory of planning and debugging. 

3.3 Artificial Intelligence ^ 

Designing an Expert for a game Is a traditional AI project. SaaueTs [1963] 
chicker playing ^program ^nd Gre€inblatt's [ 1967] chess- program have attained 
significant perforBance levelL both having beaten excellent human players. 'The 
notion of constructijig a Coach tbSutor a player in the skills of the Expert Is a 
natural extension*. * 

The goal of coaching, however, adds the design constraint that the Expert b9 
so constructed such that its expertise Is comprehensible' to a player. For this 
reason t we have proposed a rule-based approach In which knowledge Is represented 
as a modular set of rules. The traditional game playing ^programs weir^ not 
tfsually j>f this form. However, there ire a set of more recent programs that 
achieve significant parformance/ whose design does fall under this paradigm:, 
e.g. Dendra'l [Buchanan 1969} and Meta-Dendr^ [Buchanan 1972] for Mass 
Sp^troscopy and for learning Hass^ Spectroscopy 'Mycin for medical diagnosis 
(Shortllffe 1976], and EL for circuit analysis [Stallman and Su^sman 1976]. All 
of these programs perform at the level of human experts for their domain of 
expmrtlse. ^ ' 
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'Th«r« ir« ll^imions to nil«*-based s/Stey. Interactions between the n|les» 
•xceptjkons, to the rglat* and context dependency are all critical t^lHinical 
issues. Recent research by Davis [1976} an? QoTdstein [19Z6] addresses these. 
liaitafNIs and develops an approach to .providing Mta*knowledge about tlfe rules 

■' . ' . X. ■ ■ ' 

in Mchine- understandable fora. ^f|^ 

careful analysU of the virtues of rule-based syste^ (co«prehenslbillty, 
M^lari^jl, extensibility)^ theif^ «linitations and, corresponding extensions 
s^pro'priate to handling those llaitations gqes beyond tlie scope of this proposal, 
^t theoiapressive pertwrMnc^ of existing AI systeas suggests that it'-^^ll 
frOitful to apply this tedinology to the desiipi of Coapyter Coaches. / 



.4 cJ^T^i 



3.4 CiMeWir^ Sci ence 

? ' • . ' ^ ^ , 

Tw^r years "ago* a large coaputer installation such as one based on a Diflltal 

tquipaent Corporations PDP-fl wijth |[A.pro6essor would have cost .Sl.OOO, 000. 

Today* a LISP Mcliln« now^ under^ ^^^^P laboratory wUl provide^three^ttaes ' 

faster^ coaputaiion for one twentieth the cost. * The racint NSF conference on "a 

ten ^ar forecast for the ippact of (foaputers on^ education* was in' unaniaous 

agrifeaent that* the cost of coaputayrOfT^ill continue ( to decrease draaatically 

over 'the next decade [HUnRO 1976^^ 



Our proposal to develop Coaputer Coach 



es will deBal^l significant 



*coa0utfitional Mkiources. Si^h resources are available now in the research 
» environment, and econoaically feasible for schools withiihtfle next ten years. 
'The theory of ^oaputer-based coaches (end its iaple^ntation as software)* not 
the hardware technology* if the critical liaitation. 
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t , 4> A Two Year Research Progran 

/ 

We propose a threi^^hase research progran for evaluating the merits of the 
Computer Coach paradlg^^ Since phasds II and III a|i| contingent on the success 
of phase Ip 'support is requested only for the first i^ase as a two year project, 
file Mjor portion of this chapter^describes the experiaental ^rograa^for phase I. 
A suHury of phases (I and Ill^s given at th6 end of the chapter. 

4>l Ph^se I: A Computer Xoach for Wuapus 

Since an articulate Expert for Wuipus already exists, we can. directly 

' ( " ■ • 

iMMdiat^y focus our attention on the critical learning and teaching issues 
involved in designing improved modules for the Psychologist, Tutor, and Speaker. 
We estimate that the design and implementation -of a complete COACH-1 will take 
approximate l]r 10 to 12 months. The details of this design have been specified in 
(detail in chapter«Mi4 

Acrosstf the second year, we will carry out hfi extHfisive testing program to 
, ev|luate the success of the rule-besed modelling and tutoring capabilities of 
C0ACH*1. These |xperiments and the prqposti^^ubject population's are described 
^ below. The experiments will serve to rigorously test our hypothesis that e 
^ Computer Coach can tutor mathematical and scientific knowledge in personalized 
end responsive ways, and that the skills acquired by the players are 
' trens Arable. 

^ ' ^ 

We will undertake two basic categories of experiments. ^The first category 
("global e^eriments') is concerned with the overall sufcess of Uhe Coach as a 
"t^tor of transferable intellectual skills. The second category ("local 
experiments')* Is offented towards analyzing alternative damigns for various 
modules of the Coach. The first category provides the critical measure of 
success for the overall research project; the second category suggests possible 
r«rintMnts Jto tht design. 
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4.Z Global Exp»rl»0nti X 

W« ihilT^^ry out «ro Mjbr global' txptrl^mtt, ont at tho 12 aonth and ono ^ 
at tha 18 Bonth point in tjiii projact/ Each global axpa^aant will addrass two 
qiioationi: 

V 

I. Doas tha coach facilitfta tha acquisition by tha studant of tha intallactuai 
skiljf naadad to play Wi»pus7 ^ ^ 

Z. Ara thata skills transfarad to othar tasM? 

Tha skills in quastion ara tha basic logical and probabilistic infaranca rulas 
naadad to^Mlia raasonabla hypothasas about facts givan urfcartain data. 

First wa consj^r quastion 1: aaasurlng tha succass of tha Coach in tutoring 
Wunpus spacifnairyl Va wilL axaaina tha parfpraanca of thraa populations of 
playars on a co«Mn saquanca of 2S Wuapus jBaoas. Tha first pbpulation will ba 
URcoached. the second* coached by the coaputer and the third coached by a hUMUi 
taacher The sequence will Involve approxlMtely 10 sessions, each on the order of ^ 
4S.Minutas and axta^d ovar savaral waaks. Transcripts of aach playar*s 
parforaanca will ba obtainad» with statistics coaputad of his or har succass. 
(How of tan doas tha pl^yff win? How affictant ara his Bovas?) 

Our hypothasis if that tha cwiputer coachad population will acquina skill at 
tha gaaa fastar than thair counterparts who receive no tutoring and equal to tha 
rata of those players given hunan tutoring. ^ ^ 

We will also CQrrelate the performance of aeabers of the three populations 
with their skill iri traditional ■atheaatics. This skill will be atfasured by the 
standard achievtaent tests taken by the player^. This correlation will indicate 
^ether Batheaatical gaae^ such as Vuapus and their respective skills art 
accessible to student/players who have not been high achievers previoMsly in this 
lin. ' . . . 
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I • * • 

' , - - ^ ^ 1 

Question 2 exanines whether those players in the three populations who have 

Mstered^the skills of Wiioipus are able to transfer these skiils to other doaains* 

We will obtain evidencf for transference by exposing the sane three populations 

of studen.ts to (a) gases invQlving similar skTU^i^aju^ (b) problen exercises. 

An exaaple of^^different gane is 'Clue'. In this popular board gane, the 
te|k is to identify the criaHfnal froe a populatio.n of suspects. As the 
detective^ you are "giveQ various clues. The same sorts of logical' and 
probabilistic inference rules (as are required in V^JBipus) are applied to 
estiaating who had the best eotive, opportuniity and^eans. Isosorphs of this 
geae can be constructed for war game situations^ where you are given ^evidence 
about the 'location of your opponent's ships'i and your task is to estimate their 
actual location (this is a traditional game called BATTLESiPIP); for prospecting 
for ai>rd; and many other situations. The ease of creating problems requiring 
the same skills is a consequence ojT the Impprtance of the abilities required by 
Wuapus. / 4 

Problems that exercise the mathematical skills (logical and. probabilistic 
'^reasoning) required by Wumpus will be^hosen. We shall examine standards IQ and 
achievement tests as well^ as mathematical and probability^texts to select these 
problems.. will construct a set to. be administered as both a pre and a post 
test to the thr^e populations. ^ 

We shall run several series of the 'global experiment' on populations of 
different backgrounds. Our hypothesis is that the Coach Will equal a human 
teacher in facilitating the acquisition of transferable skills in Idgical and 
probabi^stic inference; as measured by performance on the problem set. 

We do not claim that the ffeMral styl9 of reasoning employed by a player will 
be affected •by the Coach» given fhe liiittd time during which players will be 
exposed to the Coach. Our hypothesis is .only that the particular skills tutored 
by the Coach are transfered. The possibility exists that the Coach could serve 
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As a^SMtral Bodal for th« studMt;^or i ctrttln kind of MthMatical rtisonlng* 
but this qutitlofi Mit await succastful ccM^lation of tht first phase of rasaarch 
OMtlinad hara. ' . ^ 

4>3 8ubJacts 

Ethication Mjors in an undergraduate college will provide the initial subjact 
population. Wa will select a group with a rani^ of achieveaMnt in MthoMtics. 
Qivan that these subjects will be future teaches, their opinions and advica 
regarding the behavior of the coach will provide'' important feedback for us 
towards lapro^^iig^ its design. Our experience with the early WUSOR co&chas 
indicates that -the gask is coaplex enough to be of interest to such students. 
Following an initial round of experlaents with this population, we will work with 
students af the saaa age froa different backgrounds (for axaaplei Chosen froei a 
two year i^hnlcal college) and then with secondary school Students. The result 
will ba evidence for the relative success of alternative teaching and Bodelling 
tachniquas for student populations of different levels of skill* age 4nd 
background. s 

Each run of. the global experiment will be done with 30 students, 10 aach 
population. Qivan several runs of the global experiaent by the end of this* two 
year prograa, sufficient j^dence should be* available to indicate clearly whether 
a w\re extensive evaluation of coaputef coaching is Justified. 

To reach a satisfactory design for the Coach, we also plan 'local* 
experlaents that analyst the perforaance of individual, aodules of the systea« 
Three ^Inds of local experlaents are defined AI, psychological ajnd 
pedagogital. These experlaents are described in the next three sections. h» 



4.4 Local AI Experlaents . ^ / 

■ — 

Theii expe^Hpts test whether th^aodules of the Coach perfora successfully 
on certain hi^y controlled exercises that are necessary (but not sufficient) 
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condltlohs for their meets in the real educational env.ironsent . Exaaples are: 
(M) at what level of skill does the Expert Bodul^ perfona the task compared to 
huMn experts^ (h) if a Siaulated Player is preated by ■edifying the Expert* will 
the Tutor successfully diagnose the edification. To illustrate this secon^ kind 
of Al^experlaent, considisr a Siaulated flayer for Wu^pus created by writing a 
prograa that has access to the logical and strategic rules, but can make na 
probabilistic inferences. The question then is whether the COACH-l modeller can 
successfi>lly diagnose this weakness. These AI experiments involve careful 
analyses of the capabilities of the modules involved. They yield, hard facts 
about performance in certain settings but no psychological data. The next class 
of experiments addresses psychological issues. 

4>3 Local Psycholopicai Experiments " 

Thesa experiments investigate the relative success of alternative modelling 
components in estimating a given player's state of knowledge. We will use the 
same teswtlng program as that outlined for the glocal experiment (Pre/Post testing 
on the game and its^isomorphs), except that intevlews with the students wherein 
t^iey describe their rationale for various moves will be obtained. Tli«^ evidence 
for the Itnowledge and Learning models will be the extent td which the student's ^ 
description of himself and his performance on isomorphs matches the hypotheses of 
these models* T 

There is also another form of validation. The Simulated PHyer whose rule 
sat most, closely matches rules attributed to the student by the Knowledge modal 
can be run to. predict likely moves by the student, in a given state of the game. 
The accuracy of these predictions with the student's actual move is evidence that 
the biowledge model is reasonable. 

Finally, we will supplement interviewing of individual players by recording 
lh« v«rbil InUrictloni of i«v«ril pliyen working as a taaa. Brown, Rublnitaln, 
•nd Burton [1976] In recent tests of the Sophll systea have used ateaa 
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MvirooMlct <imt« succtssfolly to obtain insight into tlit analyses baing aada by 

tha studants. Tha playars naturally axplain tbair raasoning .to aach othar, 

d*cra«sina dapandancy on intarviaws by tha axparlaaatar ^ 

\ 

4t6 Local Ptdagofllcal ExMrlacnts 

Coaputtr Coachas aBbody if thtary of tha syllabus and of altarnativa tutorino 

strat agios for convaying tha^ syllabus. Ha plan axparUants that tost 

altarnativa syllabi and altarnatlva tutor Ing strataglas. For axaipla. with 

rospact to tha issua of whan \o Intarnipt thi playar, tha Coach's bahavior can 

ranga fro« ona axtraaa of always discussing bottar Mvas if thay axist to tho 

othar axtraaa of only intaracting with tha playar upon explicit raquast. Our 

gool is to obtain avidanca for aachanisas by which tha Coaches tutoring cospooont 

can dynaaiically altar its cholca of tntaraction' soda arid tutoring t^lc. Thus wa 

/ . P . 

aro not intarastad in tha statistically bast syllabus or taaching styla, but 

rathar what iaprovaaant ovar tha statistical choica can ba aada' by a Coapotar 

Coach that parsonallaas tha fora and contant of tha inturactiobs on tha basis of 

avldanca availabla in tha -k^Towladga and laaming 'aodal>/ Thasa axparlaants will 

again Involva ralativaly ^aall populations, but inyolva axtansiva data-gatharing 

of protocols and intarviaws for thasa poputt^tons. / 

Wa also intand a raWTei noval axparlaent — as tha Coach, is abla io axpla^D 

itsalf, wa propose allow skillad >^uaan tej^Jjars to^pretand to ba studant 

playars and than to interrogata tha Coach on its rationala far various tutoring 

I 

raaarks. If tha Coach is successful^ it should ba abla to reply to the teacher ^s 
quari^s in |n^ acceptable fashion. 

Finally, wa will perfora careful att^tudinal studies of the subjects 
regarding their opinion of the Coach. Do they find it helpful? Does Its 
Intorvantion increase or decrease their en^oyaent of the gaaa7 Do thay find it 
too cryptitrf too verbose, or appropriately concise? These studies will bo aada 
by Mans of qoastionairas and Interviews. 
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If th«S6 experiaeftts ±oth local and global yield evidence that the 
WUSOR-II Coach provides successful modelling and tutoring capabilities, then wm 
k)Nelieve the following tifo^ases of -mork would be Justified. 

4>7 Phase 11; Experiments in Other Doaains 

In order t^o avoid errors arising froa the examination of this paradigm for 
only one domain, we would undertake to im()Ument Computer Coaches for other 
games. This effort would evdlve through the same steps as the experiments 
outlined above. The result ^of this parallel effort would be a more solid set of 
evidence on whici) to build the basic outlines of our theory of Computed Coaches^ 
and on which to evaluate their success. 

Our criteria for choosing one or more parallel domains are (a) t'hat th# gama 
exercise basic intellectual skills, (b) that the design of an Expert be feasible^ 
and (c) that the game be enjoyable and motivating. STEVEDOR is a possibla 
candidate. Recall that in this gMM, the player is asked to load a cargo t given 
various sets of siaple machines. The machines have costs associated with them: 
the task is to find the cheapest combination of simple machines adequate to aova 
the weight to the desired location. Successful play Involves in a natural way 
knowledge of ^elementary physics with obvious opportunities to tutor this subject 
matter. ^The game is simple inough to build an rule-based Expert. Our hypothesis 
Is that this would be the only module to be effected by the change in domain. 

Layman Allen has demonstrated the possibility of creating interesting 

If , • 

Intellectual gtMS such as WFF'N'PROOF anc) THEOR I ES'.N 'QUERIES in the far aor* 
rastrlctive setting of i non-computer technology. With the availability of tha 
dynamic capabilities of computers and video, the^ possibilities are unlimited. • In 
phase II, ife^ would select several gam^s that serve to exercise important 
intellectual skills but differ in interesting ways from Wumpus, after a 
pralimlnary examination oi the various candidates. 
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4>e Hunt III: A fttfttral Tlitory of Coaruttr Co^cfalaq ^ 

Tbt exHrlMct of dts^ignlnf, liplMMtlAfl aod tvilmtl^Coachts for stvtril 
doiMins sboMld provide siffltlMt •xptrltact to dtvtlop t atatrtl thtory of 
tutorliig and of Mdtlllaa. la tlia third pkast of this rtstarch, our goal would 
b9 to artlcalata tkls tbaory aad to radtslot tbt Coacbts coastracttd la tht 
prtctdlag pbasts to takt accotat optfitit iaslgbts. Tbt tbtory would cootala 
crlttrla for forMlatlag douala txptrtlst as rult systtas. for crtatlng 
|lBpllflcatloBS as tutorUg goals, for Bodalllag baowl^dgt of thtst rult systtss 
^mA lor tutoriag tbta. Tbt saat cliss of txptrlatats would l(t undtrtakta. 
^ositlvt rtsults would yltld cltar tvldtnct tbat a now klod of tducatloual 
tnvlrotwiapt ctn bt provldtd cooslstlag of coaputtr gtMS and coacbts that 
.nurturts tbt dtvtlopMirt of traasftrablt MtbtMtlcal aad scltntlfic skills* 
Fur^trwrt, sliict tht thtory is doMia-iJidaptadMt^ it will apply to traditional 
coaputtr-bastd Itaralag tuviroaMots as wtU. Fiaally, tbt gtatral thtory. btlng 



a prtcist formulation tf wdtlliag i«d tatoriag sfrilsTlls « caadidatt for a sort 
rigorous tbtory of buain ttachiag* 
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S. Resources 

S.I Tho WT Artlflcfl Inttlllfltnct Liboratory 

Tht NIT AI Ub Is • Itador in artificial Inttlllgtnce research. Intelllsent 
CMching ^rograM will not succeed without •J5j«vy Infusion of AI ex^rtlse in 
the Expert, the Tutor and the Psychologist ^dules of the Coach. The HIT AI Lab 
. has faculty and graduate students who can supply that expertise. 

Specific resources of the laboratory relevant to this research are: (a) 
expert progress for various donalns (e.g. Bathenatlcal theoran proving, 
calculus, electronics, decision asking) ; (b) natural language systeas for both 
generation and coaprehenslon: (c) advanced problea solving languages (e.g. Lisp. 
Planner. Conniver. Scheae): and (d) a powerful tlMsh^li^} systea with editing, 
Md tebyoglno c«Mt)llltlts that facillutos tht rapid dtvalopsent of prototype. 

9>2 Tha HIT Dlvlilon for Study and Research In Education 

NIT is coQcemed with the appUcatlm of technology to education Ad, at « 

a « 

d » » o n »tratlcn of that Interest, has created the Dlvlslcm for Study fnd Research 
in education. Psychologists and professional educators are on the staff of th« 
^division anc will supply useful crltlcisai of the experiments planned here. 

5>3 Technology Transfer and Lisp Hachlnes 

The NIT AI Laboratory has developed a stand-alone coaput'er that can 
provide at a reasonabla cost the kind of computer power needed fcrr thast 
experlMnts and prototypes [Greenblatt 1974]. It Mkes the r«jpearch feasibla 
now» and serves as a vehicle for the practical dlsstelnatlon of such coachin^i 
progrMS In the schools of Ihe 1960|. 
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5.4 Tlit logo ProJtct 

Tht Logo Projtct, t rtsMrch group in tbt NIT A! l§b, it concerned with 
tht itovelopMfit of iaprovtd ottucitiofiil environMnts based on the use of tdvancedy 
COBPttttr technology end on new insights into letrning that arise froa 
coi^tational sodeli of intelligence [Papert 1973]. In the Logo la1>oratory, 
children are exposed to computers and coaputational concepts as a way of 
understanding and io^oving their own efforts to learn and to solve pcobleu. By 
prograsBing thg coeiputer to draw pictures, to play ausic, to similate physical or 
biological processes, and to accomplish other substantive projects, studonts art 
introductd to iJ4K>rtant ideas in an Ktive and concrete way. 

The research proposed here benefits froa the experience of the Logo Project, 
but repreionts a^ significant ne#H^ne of research in several ways: 

* Theory: Coaputer Coaching research requires the construction of formal 
theories of problea solving and pf teaching, since these theories aust serve as 
tho basis of iaplMented aodules in the Coach. The Logo group is priaarlly 
if|terested in the development of tii/orae{ theories of problem solving, 

. sufficient to. guide a huaan teacher but not precise enough to serve as the 
basis of a tutorial prograa. ^ 

* Experiaents: The Coaputer Coach allows Rightly controlled experiaents using 
the coaching systea as a coaputational laboratory in which the aodelling and 
tutorial coaponents Cln be systematically varied. This ij a new hind of 
experiaental paradigm, not previously undertaken at Logo. 

* Tools: The Logo project has focussed its attention on the ' development of 
coaputer languages and physical devices. This proposal is concerned ins toad 
a«ith tho incorporation .of a tutoring component in the computer'. ^Coaputor 
coaching adds a new kind of tool to the Logo environment: a cognitive advisor 
for the student. 
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An Important caveat should be mntloned here. A Mjor virtue of the Logo 
Project It that It provides envlronMnts where the student has enomous freedoa. 
This Is achieved by providing the child with % general purpdse computer language 
and powerful peripherals. Traditional CAI, on the other hand, has often neant 
highly restricted environments for the* students: only stereotyped replies were 
allowed or understood. We believe the conputer gane envfronnent will provide 
sufficient freedoB and opportunity for action that the player will not be 
unreasonably restricted, while the availability of a coaputer cpach can be used 
tb provide advice about underlying Intellectual Skills that the player can 
profitably use both In the gaae. and In general. But we aust be cautious not tq 
fall Into the ^rap of achieving artificial success by reducing the student's 
options to an intellectdally uninteresting set. We can avoid this trap by 
alTbwlng the computer gaae/coach envlronmnt to naturally grow into the full 
coeiputer programing envlronMnt of Logo. This can be accospUshed by allowing 
%h% student to design his own conputer gases (for which there would be no 
computer coaches) after having Mstered the intellectual skills of those gsMS 
for which tutors *xist. 
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8. Crlttw 

A nuBbtr of potMtiil obJtcti5>ns to this rtstirch |^:^hivt occurred to th%^ 
TMdtr, In this cbtpttr* wt rtply to tht sort coMon rttctiohs. . 

r*t fro)«et r« too tM*it(oiia. /» tk« fist, some fro#oa«iit3 o/ CAi »tv« 
09«r5rfte# t*e fotejitttt 0/ cow^terj /or •^ftloi« Is tkU proposal a sii«(r«r 
O9%rstot9mnt?' 

CAI of tht sixties itttapttd wbitious projtctt with liaitod hardware #nd 
loftifirt tochnolooy. Giytn tht coriitriints on Mchinp I^m and BMory existing 
than, a projact of tha. kind outlinad hare would hava baan iaipossibla. But 
hardwara is m> longar a jiarJLous li»ltina factor: its costs ara droppiag 
drastically. A coaputational thaory of tutoring, of abdalling. of slaplificatlon 
do«s not y«t axist. But thara has baan sufficiant succass in AI. in inforMtlon 
procasslng psychology and in coaputational linguistics to aaka this rasaarch 
f^ibla. Wa baliava two yaa^ will ba sufficiant to daaonstrata tha proaiisa of 
this lina of devalopaant. 

Thara is anothar diffaranca with traditional CAI. The coaching paradiga 
•■phasixas that tha laamar as playar is in control. It is not our intention to 
usa tha cosputar to raturn to a rigid foraat of 'prograsMd instruction' . 

Finally, this rasaarch addrassas fundaaantal quastions of education. It 
provides a testbed for alternative theories of siaplification, of explanation* of 
student aodalling and huMn-orianted expertise. Trac^ional MI did not focus on 
these fundamental issues. ^ 

Skills flcy»><rerf in § n it s -i0 mt tmsjtrt ' 

It is trua that siaply playing a gaM does not guarantee the acquisition of> 
transferable skills. Indeed, repetitive play does not even guarantea parfact 
■••tary of the gaaa itsalf. It is for this reason that wa baliave Co«|^*ittr 
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Coachts havt an important role to play. Their responsibility willjbe to 
oraduarlly Introduc* th» student to taportant concepts helias not discovered for 
hlueir. 

or course, not •very gait is m suitable trtnt for learning^ganeral 
ifitolltctual skills. But we btlievt it i^ possible to design such gaMS. 
Furthereora, by having faailies of gases and a single. Coach, the Coach itself 
coufd esphasita to the studant the underlyino regularities. ^ ^ 

The danger that a fact learned in one cbntext My not be applied in another 
>s always present. We do not argue for Coaputer Coaches as the sole educational 
instruBant. But appropriate gtaes can suppleaent traditional presentation of 
Mthaaatical or scientific Mterial when suppleMnted by effective coachinT 

We plan careful exp|rlMntation regarding this transfer issue. If .Deway was 
right that paople learn by doing, we can expect positive results.! 

Artijicial iHtelligtuet reaeerc* has «ot aattiretf suffUitjtlM to produce t*e 

level 0/ f«r/onN*ce demanded bg tkU epfttcctio^. 

♦ ' - - 

AI prograas can already play gaaes well, and perfora expertly in certain 
arenas. The coapater o«ms discussed here are not abre coaplex, What is aore 
coaplex is coaMuilcating this expertise to student/player. The buU of this 
proposal addrassas this i$sue by aaans of Bddelling, siapliTication rulas. 
linguistic devices for concise discourse^ and aultiple explMation strategies. 
Whether these prove sufficient requires eviluation>O0ut we ,feel this research 
' lies on the critical path to taking educational advantage of the ongoing 
explosion of coaputer t^hnology lAto our culture. 
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7. Conclusions ^ 

For aaio^-th* "athletics^ a^al of Uarning -- gaa«s^|p^BS. coactias, t 
coapttition,4Aii-U is highly aq^^vatin^M^ axciting. Traditionally only 
. ."physical" .#ports art taui^t in this tfay. with the apre ■serious" intelWtnal 
dlftclpllnts rtltgattd to tht clissrooa. Technology is uklng possible i ntw^klnd 
ftf sport: that of thi, cotputer^basarf Hftellectual Qwm . Hence, the possibility 
exists for teachlnif the Intellectual skills these gaMs involv^e by seans of the 
"•motics" Bodal. « . ^ 

Coaputer gaaos will be widespread within five yeart. The^ s«m experience w« 

* - ' . . •' ^ ■ • ■ . 

have seen with calculators with costs dropping to an insignificant level is about 

" . ft ■ ' 

to recur for these TV gaaes. ^ Citizens of all ages will be playing and enjoying 

the sp<^t'th^y prdvide. Since these skills often involve basic aatheaatical and 

stlentli^c knowledge^ the play<r Is aequl/ing an tapoftant klnH of education In 

learning tp play the gaae. / . 

This essiur has proposed a research prograa to Investigate the design of ^ ^ 

computer coaches to facilitate the acquisition of Intellectual skills exercised ' 

Id these'^gaaes. Thyse coaches are far sore coaplex progress than the ganAs. 

thessalves^ and" it will take longer before every citizen^ can have his own^coachV 



Howevfr^ It «iould be reasonable for sehobls to provide such cca^nes^ beToci^'thejr 
are.suffJlcUirtly Inexpensive for the hoise Mrket. Indeed, such coaches Bight be 
an exciting drawing card for aany students who anrotherwlse "turned off^ b^ 
schoal. We would expect coaches to be affordable for schoolM^T^t earlya980*a 
and for the hoM by the aid 1980 'f. 



This resei^rc^ also has an important theoretical value. The design of a 
coaputer (;oach raises Mny questions central 'to psychology, to linguistics, to 
education and to' artlfical:^ intelligence. By i>roviding a coaaon research focus, 
this project offers the possibility of a dyniaic ^ynergisa between these fields. 
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Ul|laMtaly» It Is our belief that applying the conputatlonal paradigm, as It has 
been developed le AI» linguistics and psychology, to education will contribute to 
a Bore M^^rful science of learning luid of teaching. 
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